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COMPUTING CUTOFF TIMES OF BIRTH AND DEATH 

CHAINS 


GUAN-YU CHEN 1 AND LAURENT SALOFF-COSTE 2 


Abstract. Earlier work by Diaconis and Saloff-Coste gives a spectral crite¬ 
rion for a maximum separation cutoff to occur for birth and death chains. 
Ding, Lubetzky and Peres gave a related criterion for a maximum total vari¬ 
ation cutoff to occur in the same setting. Here, we provide complementary 
results which allow us to compute the cutoff times and windows in a variety 
of examples. 


1. Introduction 


Let A be a finite set and K be the transition matrix of a discrete time Markov 
chain on X. For t € [0, oo), set 



If (A m )^_ 0 is a Markov chain on X with transition matrix K and Nt is a Poisson 
process independent of with parameter 1, then Ht(x, •) is the distribution 

of Xjv t given Xo = x. It is well-known that if K is irreducible with stationary 
distribution 7 r, then 

lim H t (x, y) = ir(y), \/x, y £ X. 

£—>■00 

If K is assumed further aperiodic, then 

lim K m (x,y) = n{y), Vx : y£X. 


m —>00 


For simplicity, we use the triple ( X , K, n) to denote a discrete time irreducible 
Markov chain on X with transition matrix K and stationary distribution 7r and use 
(X,H tl 7r) to denote the associated continuous time chain introduced above. 

In this paper, we consider the convergence of Markov chains in both total varia¬ 
tion distance and separation. Let /i, v be two probabilities on X. The total variation 
distance between / 1 , v and separation of y w.r.t. v are defined by 

\\n ~ u||tv := max{/z(A) - v(A)}, sep(/i, v) := max{l - y(x)/v{x)}. 

ACA. x$LX 

With initial state x, the total variation distance and separation are defined by 


d T v{x,m) := \\I< m (x, •) - 7r|| T v, d sep (x,m) := sep(K m (x, ■), tt). 


As these quantities are non-increasing in to, it is reasonable to consider the corre¬ 
sponding mixing time, which are defined by 


T TV (x,e) := min{TO > 0| d T v(x,m) < e} 
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and 

T aep (x, e) := min {to > 0|d sep (:r,TO) < e}, 

for any e G (0,1). We define the maximum total variation distance and maximum 
separation by 

d T v(m) := maxd TV (a;, to), d aep (m) := ma xd aep (x,m). 

X^X x£X 

The corresponding mixing times are defined in a similar way and are denoted by 
T TV (e) and T sep (e). For the associated continuous time chains, we use d^y, ^e P > 
T^v and T^. The inequalities, 

d TV (m) < d aep (m) < 1 - (1 - 2 d TV (m)) 2 , 

provide comparisons between the maximum total variation distance and maximum 
separation. As a consequence, one has 

2tv( £ ) < T aep (e) < 2T TV (e/4), Ve G (0,1). 

Those results also apply for the continuous time chain and we refer the reader to |4] 
for detailed discussions and to m for various techniques in estimating the mixing 
times. 

A birth and death chain on {0,1,..., n} with transition rates pt, qi , r,; is a Markov 
chain with transition matrix K satisfying 

K[i, i + 1) = pi, K(i,i — l) = qi, K(i,i) = ri, VO < i < n, 

where Pi + qi + Vi = 1 and p n = qo = 0. Conventionally, Pi,qi,ri are called the 
birth, death and holding rates at i. In the above setting, it is easy to see that I\ 
is irreducible if and only if ptqi +1 > 0 for 0 < i < n and the unique stationary 
distribution n satisfies n(i) = c(po ■ ■ ■ pi-i)/(q± ■ ■ ■ qi), where c is a normalizing 
constant such that ^ i 7r(i) = 1. Ding et al. proved in [T2] that, over all initial 
states, separation is maximized when the chain starts at 0 or n and Diaconis and 
Saloff-Coste provided a formula for maximum separation in (10] . As a consequence, 
the mixing time for maximum separation (and then for the maximum total variation 
distance) is comparable with the sum of reciprocals of non-zero eigenvalues of I—K. 
In [7], Chen and Saloff-Coste showed that both mixing times are of the same order as 
the maximum expected hitting time to the median of it over all initial distributions 
concentrated on the boundary points. 

The cutoff phenomenon was first observed by Aldous and Diaconis in 1980s. For 
a formal definition, if d is the total variation distance or separation either in the 
maximum case or with a specified initial state, a family of irreducible Markov chains 
( X n , K n , TTn)^—-! is said to present a cutoff in d, or a d-cutoff, if there is a sequence 
of positive integers (t n )%L i such that 

Ve G (0,1), lim — n ' d ^ = 1, 

n—► oo t n 

where T n ^ is the mixing time in d of the nth chain. A family that presents a cutoff 
in d is said to have a ( t ni b n ) cutoff in d or a (t n ,b n ) d-cutoff if t n > 0 ,b n > 0, 
bn/tn —> 0 and 

Ve G (0,1), limsup ^ n ’ d ^ —— < oo. 

n—^oo On 

In either case, the sequence (t n )“is called a cutoff time and, in the latter case, 
the sequence (b n )^ =1 is called the window with respect to (tn))^. The definition 
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of cutoffs for families of continuous time chains is similar and we refer the reader 
to GB® for an introduction and a detailed discussion of cutoffs. 

Return to birth and death chains. To avoid the confusion of the total variation 
distances (resp. separation) in the maximum case and with a specified initial states, 
we use J- and J~ c for families of birth and death chains without starting states 
specified and write T L , Tf and fF R ,fF R respectively for families of chains started 
at the left and right boundary states. Diaconis and Saloff-Coste obtained in [lOj a 
spectral criterion for the existence of the separation cutoff and we cite part of their 
results in the following. 


Theorem 1.1. |T0J Theorems 5. 1-6.1] For n = 1,2,..., let K n be the transition 
matrix of an irreducible birt-h and death chain on {0,1,..., n} and A nj i,..., A n>n be 
the non-zero eigenvalues of I — K n . Set 


tri — 


£■ 


— 


l<i<n 


= £ 


i =1 


1 

~VT 


i= 1 


1 - A n 
A 2 

/ 'n,i 


Let T be the family and T c be the family of associated continuous time 

chains. 

(1) JF r has a separation cutoff if and only if t n \ n —» oo. 

(2) Suppose K n (i, i+l)+K n (i+l, i) < 1 for all i,n. Then, J- L has a separation 
cutoff if and only if t n X n —> oo. 

Furthermore, ift n X n —» oo, then has a ( t n ,a n ) separation cutoff and, under 
the assumption of (2), T L have a (t n , max{/? n , 1}) separation cutoff. 


Remark 1.1. In Theorem o the (t„,max{p„, 1}) separation cutoff of T L is not 
discussed in m but is an implicit result of the techniques therein. We give a 
proof of this fact in the appendix for completion. In the proof that there is a 
(t. n , max{/? n , 1}) separation cutoff, we show that 

J- L has a cutoff <t=> p n = o(t n ) <t=> max{p„, 1/A n } = o(t n ). 


Remark 1.2. For any irreducible birth and death chain, it was proved in m that 
the maximum separation of the associated continuous time chain is attained when 
the initial state is any of the boundary states. This is also true for the discrete time 
case if the transition matrix I\ satisfies mini K(i,i) > 1/2. As a result, if XF,T C 
and t n ,X n are as in Theorem ll.il then 

(1) T c has a maximum separation cutoff if and only if t n X n —> oo. 

(2) Assuming that infj jrl K n (i, i) > 1/2, T has a maximum separation cutoff if 
and only if t n X n —> oo. 


For cutoffs in the maximum total variation, Ding, Lubetzky and Peres provide 
the following criterion in j!2j . 

Theorem 1.2. |T2) Corollary 2 and Theorem 3] Let JF , T c , X n be as in Theorem U. 1\ 
and let T n ^ TV , T^ c ^, v be the maximum total variation mixing time of the nth chains. 

(1) T c has a maximum total variation cutoff if and only if T^ c |, v (e)A„ —¥ oo 
for some e € (0,1). 

(2) Assume that infi >n K n (i, i) > 0. Then, J- has a maximum total variation 
cutoff if and only if T ntTV (e)X n oo for some e € (0,1). 
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Remark 1.3. For any birth and death chain started at the left or right boundary 
state, the total variation distance can be different and the biased random walk 
with constant birth and death rates is a typical example. Further, the maximum 
total variation distance over all initial states is not necessarily attained at boundary 
states and a birth and death chain with valley stationary distribution, a distribution 
which is decreasing on {0,..., M} and increasing on {M,..., n} for some 0 < M < n, 
could illustrate this observation. This is very different from the case of separation 
and we refer the readers to Sections [5] and [5] for more discussions. 

To state our main results, we need the following notation. For n £ N, let 
X n = {0,1,..., n} and ( X be an irreducible birth and death chain on X n 
with transition matrix K n and stationary distribution 7r n . Let Nt be a Poisson 
process independent of (X^) with parameter 1. For i £ X n , set 

(1.1) = inf{m > 0|X<” } = ij, T t (n) = inf{f > 0|X^ = *}. 

For j £ X n , let Ej and Var., denote the conditional expectation and variance given 

y (") _ A 

~ J- 

Remark 1.4. It follows from the definition of rj n \f- n ^ that E jT^ = E jT- ’ 1 ' 1 for all 
i,j£ X n . See [I] for more information of the hitting times T^ n \f^ n \ 

Theorem 1.3. Let X,T Cl X n be as in Theorem 11.11 and T < j n ’ > , be the hitting 

times in (Ob For n > 1, let M n £ {0,1,..., n} and set 

s n = Eo?g + E „7g = Eorg + E 

and 

b 2 n = Var 0 t^I + Var „r^, c 2 n = Var 0 r^ + Var . 

Suppose that 

(1.2) inf 7r„([0,M n ]) > 0, inf n n ([M n , n]) > 0. 

n >1 n>1 

Then, the following properties hold. 

(1) J-L has a separation cutoff if and only if s n X n —> oo if and only if s n /b n 
oo. Furthermore, if s n /b n —> oo, then fFff has a ( s ni b n ) separation cutoff. 

(2) Assume that K n (i,i + 1) + K n (i + 1, i) < 1 for all i,n. Then, F L has 
a separation cutoff if and only if s n X n -A oo if and only if s n /c n —> oo. 
Furthermore, if s n /c n —> oo, then T L has a (s ni max{c„, 1/A„}) separation 
cutoff. 

Remark 1.5. Let a n , Pn be the constants in Theorem ll.il Let M n , M’ n £ {0,1,..., n} 
and b n , c n ,b' n , c' n be the constants in Theorem 11.31 defined accordingly. Suppose 
M n , M’ n satisfy (11.21) . Then, 

b n - b’ n x o n , max{c„, l/X n } x max{c'„, 1/A n } x maxlp^, 1/A n }, 

where u n x v n means that both sequences, u n /v n and v n /u n , are bounded. See 
Corollary 12.31 for a proof. Comparing Theorems 11.11 and 11.31 one can see that the 
cutoff window for Tf is unchanged up to some universal multiples but the cutoff 
window for T L can have a bigger order in Theorem 11.31 due to the change of the 
cutoff time. 

In total variation, we have the following result. 
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Theorem 1.4. Let T, T c , X n be as in Theorem 11.11 and r/™" 1 . t,-' 1 - 1 
times in CD- Let M n £ {0,1, n} and set 

d n = max |e 0 , E„r^ } = max {e 0 t^ , E n r^ j 

and 

al = max j Var 0 rj^, Var n r^ | 


be the hitting 


and 

Pn = max | Var 0 r^, Var|. 


Suppose 

(1.3) inf 7r„([0, M n ]) > 0, inf n n ([M n ,n]) > 0. 

n>l n> 1 


7n f/ie maximum total variation distance: 

(1) T c has a cutoff if and only if 9 n \ n —> oo if and only if 9 n /a n —> oo. 
Furthermore, if J- c has a cutoff, then T c has a ( 9 n ,a n ) cutoff. 

(2) Assume that inf, )n K n {i , i) > 0. Then, T has a cutoff if and only if 9 n \ n —> 
oo if and only if 9 n /f3 n —> oo. Furthermore, if F has a cutoff, then F has 
a ( 9 n ,p n ) cutoff. 


Remark 1.6. In Theorem 11.41 if 8 = inf i, n K n (i,i), then ScPf < < a^. See 

Remark 15.51 for details. 


Remark 1.7. Let T = (X n , K n ,n n )^fL 1 be a family of irreducible birth and death 
chains with X n = {0,1, ...,n}. For a £ (0,1), set M n (a) be a state in X n satisfying 

7r„([0, M n (a)]) > a, 7 T n ([M n (a),n]) > 1 - a. 

By Theorem 11.11 and R emark 1 1.2 1 if T c has a cutoff in maximum separation, then 


(1.4) 


,. E or£ (a) +E n ?£ 

lim - , r ■ -- 7 > 1 = 1, 


E 0 T £(t,) + E « T M„(6) 


“(«) 


V0 < a < b < 1. 


From Theorenr ll.41 if T c has a cutoff in the maximum total variation, then 
(1.5) 


max{E 0 rg E„r{2 (a) } 

Inn -- n y > =1, V0 < a < b < 1. 

n—> oo tviov/TF irr ~\ n ) 


max{E 0 T^ (6) ,E„r^ (6) } 

But, the converse of these statements are not necessarily true. For example, let 
K n {i, i + 1) = K n (i + l,i) = 1/2, V0 < i < n, K n (n, n) = 1/2, 

and 


K n (0,l) = K n (l,0) = £ n , K n (0,0) = l-tf n , K n ( 1,1) = 1/2 - 

where £ (0,1/2). Note that K n can be regarded as the transition matrix of 
a simple random walk on X n with specific transitions at the boundary states and 
a bottleneck between 0 and 1 when £„ is small. It is clear that the stationary 
distribution satisfies 7 r n (i) = l/(n+ 1) for all 0 < i <n. After some computations, 
one has, for n large enough, 

M n (a) x n x (n - M n {a)). 
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This implies 

®o T Mn( a ) = 7—b M n (a)(M n (a) + l)-2x ——h n 2 

n s n 

and 

E "^Afi(o) = ( n ~ M„(a))[n - M n (a) + 1] x n 2 . 

Let Pn t i,qn,i,r nt i and A„ be the transition rates and the spectral gap of I\ n . By 
Theorem 1.2 in [7], we have 


( 1 . 6 ) 


1 

— x max 


max 

j:j<M n 


y 1 OM) i max y Ub>]) 

f-' 7T n{k)p n ,k'r-j>M n f-' 7r n (k)q n ,k 
k—j fc=M n + l 


where M n = |_n/2_|. This implies 

1 1 2 

— x — +n . 

/ 'n s n 

As a consequence of Theorems 11.31 and 11.41 F r has neither a maximum separation 
cutoff nor a maximum total variation cutoff. Let s n and 9 n be the constants in 
Theorems II. 31 and II. 41 If n 2 £„ —> 0, then 

s n ~ 9 n ~ E 0 r^ (a) ~ Vo £ (0,1). 

S n 

The above example illustrates that CE3D and (ED are necessary but not sufficient 
for the existence of the corresponding cutoffs. 


The following theorem describes one of the main applications of Theorems 11.31 


PI 


Theorem 1.5. Consider a family F = (X n , K n ,Tr n )^f =1 of irreducible birth and 
death chains with X n = {0,1, For n > 1, let (f2 n ,P^) be a probability space 

and C n ^i,...,C ntn : f i n —>• (0,1) be independent and identically distributed random 
variables. For ui n £ and 0 < i < n, let (X n , L^ >n \ n n ) be a Markov chain given 
by 

[ L^ n \i,i + 1) = K n (i,i + l)C n , i+ i(u> n ), 

< L ( n n \i + 1 ,i) = K n (i + 1 ,i)C n ,i+l{u n ), 

= 1 - + 1) - L^ n \i, i - 1), 

and, for to = (wi,w 2 ,---) £ EEi ^n, let F^ = (T„,L^ n) ,7r n )^ =1 . Let F C ,F^ 
be the continuous time families associated with F, F^\ For n > 1, set p n = 
E(1/C' 71] i), v 2 = Var(l/C ni i) and let 9 n ,a n ,f3 n be the constants in Theorem E3 

(1) If F c has a maximum total variation cutoff and v n a n = o{p n 0 n ), then there 
is a sequence E n C fl n such that P( n '(E n ) 1 and, for any u> £ ee E n , 
F^ has a maximum total variation cutoff with cutoff time p, n 9 n - 

(2) Assuming inf n ,iK n (i,i) > 0 and replacing a n by ft n , the statement in (1) 
also holds for the families F , F^. 

Remark 1.8. In Theorem 11.51 L n can be regarded as a random birth and death 
chain obtained by applying i.i.d. random slowdowns on K n without changing the 
stationary distribution. 

Remark 1.9. Theorem 1 1.51 also holds in maximum separation. 
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The remaining of this article is organized in the following way. Sections [2] and [3] 
contain the proofs of Theorems 11.31 and 11.41 respectively. The proof of Theorem ll.51 
is given in Section [I] We also introduce another randomization of simple random 
walks on paths and discuss its cutoff and mixing time. In Section [5] we consider 
families of chains started at one boundary states and provide criteria for the exis¬ 
tence of a total variation cutoff and formulas for the cutoff time. We discuss the 
distinction between maximum total variation cutoffs and cutoffs from a boundary 
state and illustrate this with several examples in Section [6] The main results of 
Section [5] are proved in Section 0 In Section [5J we apply the developed theory 
to compute the cutoff time of some classical examples. Some useful lemmas and 
auxiliary results are gathered in the appendix. 


2. Cutoff in separation 


This section is dedicated to the proof of Theorem [L3] and we need the following 
two lemmas. The first lemma concerns the mean and variance of hitting times and 
the second lemma provides a comparison of spectral gaps. 


Lemma 2.1. Let I\ be the transition matrix of an irreducible birth and death chain 


on {0,1, ...,n}. For 1 < i < n, let fti , ■ be the eigenvalues of the submatrix 

of I — K indexed by {0,..., * — 1} and set 

(2.1) Tj = min{m > 0\X m = i}, % = inf{f > 0|Xjv t = i}, 

where (X m )f%—o is a Markov chain with transition matrix K and N t is a Poisson 
process independent of X m with parameter 1. Then, £ (0,2) for all 1 < j < i 
and 


(i) 


( 2 . 2 ) 


and 


(2.3) 


Eqt, = Eon = Y, 

7 = 1 Pj 


* l- B y 

Var 0 (n) = - - 


« 


7 = 1 


(4 


Var 0 (n) = ^ 


7 = 1 




Proof. Let K be the submatrix of K indexed by {0,1,...,* — 1}. Let /3 be an 
eigenvalue of K and x = (xq, ..., a?i-i) be a left eigenvector associated with /3. That 
is, 

f pxj = K(j - 1 ,j)xj_i + K(j,j)xj + K(j + l,j)x j+1 , VO < j < i - 1, 
hx o = K(0,0)x o + K(l,0) Xl , 

= K(i - 2,i - l) Xi _2 + K(i-l,i- l)xj_i. 

By the irreducibility of K, if Xi-i = 0, then Xj = 0 for all 0 < j < i. This implies 
Xi-\ ^ 0 and then 

i —1 i— 1 i —1 

1^1 1*71 ~ K (i ~ <EN- 

7=0 7=0 7=0 

Since x is an eigenvector of I\ , \ X j\ > 0 and thus |/3| < 1. This proves that 
Bj 1 ' 1 £ (0,2) for all 1 < j < i. For (12.21) and (12.31) . note that the distribution of 
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Tj was given by Brown and Shao in [3] and the technique therein also applies for 
t». This leads to the desired identities, where we refer the reader to their work for 
details. □ 

Remark 2.1. In Lemma T2.11 the first equality of (12.31) implies 

1 


£ 


a£iv vi>i. 


UiPf ) 2 SS/f 

Lemma 2.2. Let K be the transition matrix of an irreducible birth and death 
chain on {0,1, with stationary distribution n. For 0 < i < n, let Li be the 

sub-matrix of K obtained by removing the row and column of K indexed by state i. 
Let Ai < • • • < A„ be the non-zero eigenvalues of I — K and X\ < ■ ■ ■ < X n be the 
eigenvalues of I — Li. Then, 


xf < A, < \f +1 < Aj +1 , VI <j< n, 


and 


( min{7r([0,i]),7r([i,n])} 


Ai < < Ai. 


In particular, if M is a median of it, i.e. 7r([0,M]) > 1/2 and tt([M, n]) > 1/2, 
then Ai/8 < x[ M ^ < Ai. 

The proof of Lemma l2T2l is based on a weighted Hardy inequality obtained in [7] 
and is discussed in the appendix. In what follows, for any two sequences of positive 
reals a n ,b n , we write a n = o(b n ) if a n /b n — > 0 and write a n = 0(b n ) if a n /b n is 
bounded. In the case that a n = 0(b n ) and b n = 0(a n ), we write a n x b n instead. 

Proof of Theorem Q751 Let X n ^,X n ,t n ,a n , p n be constants in Theorem 11.11 Note 
that, for n > 2, 

n i f 

max{p^ i/A^} < CT 2 = ^ 

i=1 A mi 


This implies 
(2.4) 


\/U^< — < 


£ tnXn- 


a n maxjpn,1/A n } 

As a consequence, we have 

(2.5) t n A„->• oo tJn = o(t n ) max{/9n ; 1/An} = o(t n ). 

Next, let s n ,b n , c n be constants in Theorem fL3l Observe that 
1/A„ < max{p„, 1/A„} < a n . 

Set a n = min{7T„([0, M„]), 7r n ([M n ,n])}. By Lemmas 1 2.1 1 and [££1 one has 


and 


tn — T 


< < bl < a 2 n + 


4 4 a n 

—— < t n + — 


l.Xr 


< 


17*2 


According to the assumption of m, we have a n x 1 and this implies 

tn An ^ CXD SfiXn ^ OO 









COMPUTING CUTOFF TIMES OF BIRTH AND DEATH CHAINS 


9 


and 


(2.6) I t n - s n | = 0(cr„), I t n - s n | = 0(max{p n , 1/A n }), b n x a n . 
As a consequence of (12.51) and (12.61) . we obtain 


(2.7) t n X n ^ oo b n — o(sn) max{c„, 1/An} — o(sn). 


The first equivalence of (HD proves the criterion for cutoff in (1). For (2), if T L has 
a separation cutoff, then Theorem 11.11 implies t n A„ —> 00 . By the last identity in 
ED , we obtain c n = o(s n ). To see the inverse direction, observe that the mapping 
u i-A (1 — u)/u 2 is decreasing on (0,2] and X n ^ £ (0,2) for all 1 < i < n. In the 
same reasoning as before, Lemmas 12.II and 12.21 yield 


( 2 . 8 ) 


< 4 < Pi 


1 ^nAn/4 
(a n A n /4) 2 


A n,n 1 

\2 

/x n,n 


<Pn 


17 

a n^n ' 


By the first inequality of (12.81) . if c n = o(s n ), then p n = o(s n ). Accompanied with 
the facts, 

4 ( 4 A 

Sn — tn T 7 A: ( 1 T I tn, &n 1, 

0*71 An \ / 

we obtain p n = o(t n ). By Remark ll.il T h has a separation cutoff. 

To see a window, we recall Corollary 2.5(v) of 3], which says that if a family has 
a (tn, dn) cutoff and 


bn — o(tn) (Ol b n — o(Sn)), | t n Snj — L)[b n f (Tn — tDibjfj, 

then the family has a (s n ,b n ) cutoff. By Theorem 11.11 the desired cutoff for fFjf 
is given by the first and third identities in (12.61) . while the desired cutoff for T L is 
provided by the second identity in (12.61) , the third identity in (12.71) and the following 
observations 


max{p„, 1/An} ^ max{Cn, 1/A n }, max{p n , 1} = 0(max{c„, 1/A n }), 
which are implies by (12.81) and the fact A„ < 2. □ 


In the following corollary, we summarize some useful comparison between the 
variances of hitting times and the windows of cutoffs obtained in the proof of 
Theorem 11.31 


Corollary 2.3. Let K be the transition matrix of an irreducible birth and death 
chain on {0,1, ...,n} with stationary distribution tt and Ti,Ti be the hitting times in 
ED- Suppose Ai,...,A„ be non-zero eigenvalues of I — K and set 


t = J2 


i 

A? 


Si 

i =1 t 


2 2 . 
p = a - t, 


A = min 

1 <i<n 


Then, for 0 < i < n, 


t < E on + E„7j 


E 0 n + E„n < t + 


4 

a{i) A 


and 


(T 2 < Vai'on + Var„n < 


17 a 2 


p 2 < Vai'on + VainT i < p 2 + 


17 

a(l) 2 A 2 ’ 


where a{i) = min{7r([0, i]), 7r([*, n])}. 
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To determine a cutoff time and a window using Theorem 11,31 one needs to 
compute the mean and variance of the hitting time to some state given that the 
chain starts at one boundary state. Explicit formulas on both terms are available 
using the Markov property and we summarize them in Lemma lA.il 

The next proposition discusses the cutoff times obtained in Theorem 11,31 and 
provides a universal lower bound on the corresponding windows using the transition 
rates and the stationary distribution. 


Proposition 2.4. Let K be the transition matrix of a birth and death chain on 
{0,1,..., n} with transition rates Pi,qi,ri. LetTi,Ti be the hitting times in (12.11) and 
set 

s(i) = EqTj + E n Ti, b(i) 2 = Var 0 (Ti) + Var „(?*). 


Suppose K is irreducible with stationary distribution i r and spectral gap A. Let 
M £ {0,1,...,n} be a state satisfying 7r([0,M]) > 1/2 and 7r([M,n]) > 1/2. Then, 
for 0 < i < j < M , 


(2.9) 


and, for 0 < i < n, 


j -1 

s(i) - s(j) = 

e=i 


i — 27 t([o, a\) 

PtK(l) 


> 0 , 


( 2 . 10 ) 


hi S) > j > 


1 

— max max 
2 0 <j<M<k<n 


hi 5 t=M+\ j 


Proof. (12.91) is given by Lemma IA.1I and the first inequality of (12.101) is obvious 
from Lemmas 12.1112.21 while the second inequality of (12.101) is cited from Theorem 
A.lofjZj. □ 


Remark 2.2. Let s n , t n be the constants in Theorems 1 1. HfTTdl By Corollarv l2.31 one 
has s n — t n > 0 and, by (|2.9I) . the difference s n — t n is minimized when M n satisfies 

7r„([0,M n ])>l/2, 7T„([M„,n]) > 1/2. 


3. Cutoff in total variation 

This section is dedicated to the proof of Theorem 11.41 Throughout the rest of 
this article, we will write Pi to denote the probability given the initial state i. First, 
recall two useful bounds on the total variation. 

Lemma 3.1. [7) Proposition 3.8 and Equation (3.5)] Consider a continuous time 
birth and death chain on {0,1,..., n} with stationary distribution it. For 0 < i < n, 
let Ti be the first hitting time to state i and d^y(i,t) be the total variation distance 
at time t with initial state i. Then, for 0 < i < n and 0 < j < k < n, 

c4v(b t) < E J (max{f i , f k } > t) + 1 - 7r([j, k]) 

and 

<4v(M) > PoOn >t)~ 7r([0, i — 1]). 

Based on the above lemma, we may bound the maximum total variation mixing 
time using the expected hitting times. 
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Theorem 3.2. Let 7 r, t,; be as in Lemma \S.l\ and set 

d(i) = max{E 0 f,, E n ?j}, a{ij 2 = max{Var 0 T), Var„Ti}. 

The maximum total variation mixing time satisfies 

T$ (ei) < 0(j) + E jT k + E k Tj + ^(f - l) max{a(j), a(k)} 

and 

Tiv(e 2 ) > 0{j) - E k Tj - ^(y-l) max{a(j), a(k)}, 

for any 0 < j < k < n and 6 £ (0,1), where ei = 1 — n(\j, k]) + 6 and e 2 = 
minML?, n]), tt([0, k])} - S. 

Proof. We first consider the upper bound. Set ei = 1 — n([j,k]) + 6. By Lemma 
13.11 if i < j , then 

dxv(h *) < Po(Tfc >t) + 1 - 7r([j, k]). 

As a result of the one-sided Chebyshev inequality, this implies 
T Tv(b £ i) < e oA; + \J{\- 1 )a{k). 

Similarly, if i > k , then 

^Tv(*.ei) < + \J(^- 1 )a(j). 

Note that, in the case j < i < k, 

Pj(max{rj, Tfe} > t) < P^Tfc > t) + P >t)< P j(r k > t) + P k (rj > t). 

This implies 

T$(i, ei) < E jT k + E k Tj + ^/(f — l) max{a(j), a(k)}. 

Combining all above gives the desired upper bound. 

For the lower bound, set e 2 = min{7r([j, n]), 7r([0, fc])} — S. By the second in¬ 
equality of Lemma 13.11 one has 

^Tv(0,i) > 7T- P 0 (tj < t). 

Setting t = Eot, — y/(l/5 — l)a{j) in the above inequality derives 

<4v(M) > ^{{j^n]) - S > e 2 . 

This implies 

2tv( e 2 ) > T$( 0,e 2 ) > E 0 Tj - y/{j- 1 )a(j). 

Similarly, for k > j, we have 

T$(e 2 ) > E„r fc - - l)a(k) = E n Tj - E k Tj - yj- l)a(fc). 

Both inequalities combine to the desired lower bound. □ 

Proof of Theorem ] l.)\ ) Continuous time case). It has been shown in [12] that sepa¬ 
ration is maximized when the chain started at any of the boundary states and the 
maximum total variation cutoff is equivalent to the maximum separation cutoff. It 
is clear that the constants, s n and 6 ra , in Theorem 11.31 are respectively of the same 
order as the constants, 0 n and a n , in Theorem 11.41 As a consequence of Theorem 
[L3l T c has a cutoff in the maximum total variation if and only if 9 n X n —> 00 if and 
only if 0 n /a n -A 00. 
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To see a cutoff time and a window, we assume in the following that Q n /otn —> oo. 
Set 

e 0 = inf min{7r„([0,M„]),7r„([M„,n])}. 

n 

For e £ (0, eo), we may choose x ni y n such that 
7r n ([0,a; n ]) > |, 7T„([o;„,n]) > 1 — 7T„([0,y„]) > 1 - 7r„([t/„,n]) > 

Clearly, Replacing j, fc, d with x n ,y n , e/3 in Theorem 13.21 yields 

Erv( e ) < 0n{x n ) + ^x n T^ +E y n T^ + max{a„ (x n ), a n (y n )}, 

where 


0n{j) ■■= max{EoTj n) ,E n 7-j n) }, a 2 n (j) = max{Var 0 rj" } ,Var„rj n) }. 

In the above notations, 9 n = 0 n {M n ) and a n = a n {M n ). Since x n < M n < y n , 
has 


E„ 


r(" 


= E„rg+E Mn ri: 


Eof<g = E, 


-o r. 


(n) 


■ E, 


~(™) 
M n ' 


Note that, for any positive reals a, b, c, d, 

| max{a + 6, c} — max{a, c + d}| < max{&, d}. 


one 


This implies 


K(x n ) - e n I < Er^j + E Mn r^ < E Xn &> + E yn r£ 


According to the definition of x n ,y n , M n , Corollary 12.31 implies 


l ( Xn ) 


x-n ^ xxn 


(Vn)- 


Let p n ,f., Qn,e be the birth and death rates of the nth chain. The replacement of 
j. M, k with x n , M n , y n in (12.101) yields that, for any 0 < i < n, 


1 


' M n ~ 1 


E 7Tn([0,^n]) y' K n ([Vn, M ) 


a n (i) > —■= max . , , , 

XtZn Pn,^n{Z) ^ qn,tMQ 


> 


Vn~l 

e \ ' 1 


E 


E 


i 


12x72^ Pn,fKn(Z) 12\/2 e J^ +1 q n ,e^n{Z) 


> 


12x72 


max{E a: „r(” ) ,E y „r^ ) }, 


where the second inequality uses the fact q n ,i^n{Z) = Pn,t-i^{Z — 1) and the last 
inequality applies the first identity in Lemma IA.1I As a consequence, we may 
conclude from the above discussions that 

T n%vi e ) -®n< + yEj max{a„(ai n ), a n (y n )} x a n , 

for all e £ (0,eo). In a similar statement, one can show, by the second part of 
Theorem 13.21 that 

/ 36\/2 /3 \ 

- ^tv(1 - e) < I —--b I/ - j max{a„(i„),a n (j/„)} = 0(a„), 


for all e £ (0,eo). This proves the (9 n ,a n ) cutoff for T c . 


□ 
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Proof of Theorem \l Discrete time case). We will use the result in the continuous 
time case and (6] to deal with the discrete time case. Set 

6 = inf K n {i, i), K < 4 > = {K n - 51)/{l - 5). 

n,i 

In the assumption for discrete time case, we have 5 £ (0,1). Let X n = {0,1, 

= (X n ,KP ,7r„)“ =1 and J~c ^ be the family of continuous time chains asso¬ 
ciated with It was proved in [6] (See Theorems 3.1 and 3.3) that, in the 

maximum total variation, 

(3.1) T has a cutoff <t=> has a cutoff 

and 


(3.2) T has a ( t n ,b n ) cutoff <t=> T/ S) has a ((1 — 6)t n ,b n ) cutoff. 

Let be the hitting time to state i of the continuous time chain associated 

with Kn and E,, Var,; be the conditional expectation and variance given the initial 
state i. Set 

8^ = max {Eqt^ , = max | Var 0 ?^ ,5) , Var^j^ }. 

For J~c ^, it has been proved in the continuous time case that 

has a cutoff o 9^ —> oo <(=> 0^ /—>• oo, 

where A ^ is the smallest non-zero eigenvalue of I — Kn ^ • Furthermore, if it holds 
true that 6n' > /Pn' > —> oo, then has a (9n\/3n' > ) cutoff. As a result of (13.11) and 
(EH), we have 

T has a cutoff o 9^//3^ —>• oo, 

and, further, if the right side holds, then T has a (9 ^/{1 — 5),f3n^) cutoff. 

Let \ n ,9 n ,/3 n be the constants in Theorem 11.41 Clearly, A n = (1 — 5)A^ S \ To 
finish the proof, it suffices to show that 

(3-3) 9& = (1 - 5)0 n , x /3 n - 

Let p n ,i, q n ,ii fn,i be the transition rates of K n and Pn\, Qnlxnl be the transition 
rates of Kn\ It is clear that 

Pnl =Pn,i/( 1 - S), q ( n}=q n ,i/(l-5), r^ i = (r n ,i-6)/(l-6). 

The first equality of (13.31) is an immediate result of the first identity of Lemma fA.il 
To see the second part of ESP , let A n) i,...,A nt n be eigenvalues of the submatrix 
of I — K n obtained by removing the M n - th row and column. Clearly, A ni i/(1 — 
5 ),..., A ntn /(l — 5) are eigenvalues of the submatrix of I—Kn ^ obtained by removing 
the M n -th row and column. As a consequence of Lemma 12.11 we have 


1 _ X 

a 2 „ \ ^ 1 A n,i 

Pn \2 

j —1 A n,i 



*E 


i 



Note that the application of Remark 1 2. 11 on the chain (X n , K„\ n n ) says 


(i-<)E 

2=1 



^E 
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This implies x 


□ 


4. A RANDOMIZATION OF BIRTH AND DEATH CHAINS 


This section gives two nontrivial examples as applications of theorems in the 
introduction. The first example is stated in Theorem 11.51 and we discuss its proof 
in the following. 

Proof of Theorem 11.51 The proofs for T c and T are similar and we consider only 
the continuous time case. Let M n ,9 n ,a n be as in Theorem 11.41 For convenience, 
we let (p n ,i, hn,i, Ai,i) be the transition rates of K n . For n > 1, set 



and 



Tn ( 1 ) Un..i~r> O' 


It is clear from Lemma [A . 11 that 


6 n = max{d ni i, 0 ni 2 }, a n = max{a nj i, a„, 2 }. 


Without loss of generality, we may assume that 9 n = 6 n p. For n > 1, let [/„,i, I4,i 
be positive random variables defined by 



MM ) 2 


Tn (h)pri.i LVa.z+I T n (j )p n ,j Cn,j-\-l 


By the independency of C n< i , one may compute 


E17n,l — 1 — P>n9m Vai'(t/ nj i) — V 



and 



< (/4 + OMn, 1 < Kh-n + Vn)a n ,l] 2 - 

The estimation for EF 2 implies 



Set a n = V \p n 9n)l{y n OL n ), b n = x / (Mn)/[M + v n )a n ] and 

An,l = ^ • |bO,l(On) hn9n\ ^ Lnp^n) ^ b n (fi n T V 1 i)cy n f. 


Since jF c has a maximum total variation cutoff, Theorem 11.41 implies a n = o(9 n ). 
In the assumption of ( v n a n ) = o(n n 9 n ), it is easy to see that, for u> n £ Fin,!, 


bO,l(Fn) ^ hn,9m — o(l^n^n)- 


By the Chebysliev and Markov inequalities, the fact that a ni b n —> oo yields 


P (n) M,i) 1. 
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In the same way, we set 

7r n ([*,rc]) 


Un,2 ~ 


i=M n +1 




: V ~,2 = £ £ 


.(M) s 


z=M n +1 j=M n +1 


5"n {i)Qnd En . i Tn (j')Qn,jC'n,j 


and 


En,2 — {k^n ^ • Un,2{j^n) ^ /Xn9n T On^nOln, Fn, 2 (^ 71 ) ^ bn^f-^n “1“ 

A similar reasoning as before yields that —► 1 and, for ui n £ E n 

U n , 2 (^ 71 ) £ /In^n( 1 T o(l)), hn, 2 (^n) = o(/T n $ n ). 

As consequence, if we set i?„ = -E^i fl E n , 2 , then P(")(.E ra ) —>• 00 and, for £ E n , 

max{t/ nj i, tin,2} ^ l^n@m max{I 4 i i, 1/1,2} — o(/x n ^ n ). 

The maximum total variation cutoff for and the cutoff time yL n O n are imme¬ 
diate from Theorem II. dl □ 


Remark 4.1. From the proof given above, one can derive a variation of Theorem 
11.51 Namely, under the assumption of u n a n = o(n n 9 n ), if F c has no maximum total 
variation cutoff (resp. maximum separation cutoff), then there is a sequence E n C 
fl n satisfying P ( n \E n ) -A 1 such that F^ has no maximum total variation cutoff 
(resp. maximum separation cutoff) for w £ Yl^LiE n - Note that, the requirement 
u n a n = o(fj, n 9 n ) and the assumption of no cutoff will imply the existence of a 
subsequence, say i n , such that Vi n = o(/j,i n ). As a result of the Chebyshev inequality, 
1/C^.i — E(l/Ci nj i) converges in probability to 0. This turns Fc^ into a lazy 
version of F c with high probability. 

Note that the hypothesis of u n a n = o{n n 9 n ) requires the existence of a second 
moment of 1 / C n ,i- Next, we give an example where 1 /Cn,i does not have a finite 
first moment. 


Theorem 4.1. For n > 1, let C nt i, ...,C n>n be i.i.d. uniform random variables 
over (0,1) defined on (fl n ,P^"^). For 00 = (wi,W 2 ,---) £ 11,1 ^n, let F^) = 
(X n , 7r„)^ =1 be a family of birth and death chains with X n = {0,1,..., 71 } 

and 

(Ki Un \i,i + 1) = K(i + l,i) = C n , i+ i/ 2, VO < * < n, 

{K^ n) (i, i) = 1 - K^ n) (*, * + 1) - K< Un) (i, i - 1), Vi. 

Let F^ be the family of continuous time chains associated with FEl and, for c o n £ 
f l n , let Tf TV (w ra , •) be the maximum total variation mixing time for ( X n , K , 7r„). 
Then, there is a sequence E n C Sl„ satisfying p(")(£ , ra ) —>• 1 such that, for any 
ui = (wi, W 2 ,...) £ n~i E n , the family F^ has no maximum total variation cutoff 
and Tf TV (Lo n , e) x n 2 logn for e £ (0,1/10). 

Proof. Let M n £ X n and t/ n p, U n ,i be as in the proof of Theorem ll.51 For n > 1, 
set 

n„ = ( C n ,i > r~ ,VI < i < 4 > P (n) (-) = P (n) (-Pn), 

n log n J 

where P* ' is the conditional probability of P ( - r d given Q n . Clearly, P(")(f]„) = 

_ ( n ) 

(1 — 1/nlogn)™ —> 1 and, in P , C n 1 ,..., C7 n n are i.i.d. uniformly distributed over 
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(1/nlogrz, 1). Let E and Var be the expectation and variance taken in 
an easy exercise to compute 


m(”) 


It is 


m/Cn, l) = 


log n + log log n 
nlogn 


logn 


and 


Var(l/ C Uy i) = nlogn - (E(l/C rii i)) 2 ~ nlogn, 

This implies that, if M n -A oo and n — M n —> oo, then 

EUn }1 ~ Ml log n, WJ n ,2 ~ (n - M n ) 2 log n, 

and 

Var(t/ nj i) ~ M 2 nlogn, Var([/„, 2 ) ~ (n - M n ) 2 nlogn. 

For a G (0,1), if M n = [an\, we write U for U n j. As a result of the above 
computation, we obtain 


E U^l ~ a 2 n 2 logn, E~ (1 — a) 2 n 2 log 


H77v( a ) 


and 


Var(/7^“ 1 ) ) ~ a 2 n 3 logn, Var (ufy) ~ (1 - o) 2 n 3 logn. 

For n > 1, let 

E n = |w„ G A n : \U^l - a 2 n 2 logn| < n 3/2 logn, for a = 1/4,1/2. 


It is easy to show that P ( "' (E n ) —a 1 and, hence, P( ra ) (E n ) > pOd (A n )¥ [n> (E n ) —a 1. 
Furthermore, for G E n , 

.2 1 




and 


~ n 1 ? Sn 


ma A U nl i \un),U^2 i) (U n )} ~ ^ ^ ” ■ 


By Remark 11.71 has no maximum total variation cutoff for ui G ]/[ E n . The 
order of the mixing time is given by Theorems 3.1 and 3.9 of [7]. □ 

Remark 4.2. We refer the reader to HU for another randomization of birth and 
death chains, which is different from the one considered in Theorem 14.II 


5. Chains started at boundary states 

For continuous time birth and death chains, I.12| shows that separation reaches 
its maximum when the initial state is any of the boundary states. This is not true 
in the case of total variation and it is easy to construct counterexamples. In this 
section, we discuss the total variation cutoff for families of birth and death chains 
started at a boundary state. As before, we use J- and T c for families of birth 
and death chains without starting states specified and write T L ,T R and T R ,T R 
respectively for families of chains started at the left and right boundary states. 

The following theorem displays a list of equivalent conditions for the total vari¬ 
ation cutoff. It is worthwhile to note that some of these conditions are very similar 
to the conditions in Theorem II. 41 
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Theorem 5.1. Let F = (X n , K n , 7r n )^L 1 be a family of irreducible birth and death 
chains with X n = {0,1, ...,n} and F c be the family of associated continuous time 

~(n) 

chains in F. For n > 1, let be the first hitting time to state i of the nth chain 
in F c and, for a £ (0,1), let M n (a) be a state in X n satisfying 

7Tn([0, M n (a)\) > a, 7r„([M„(a),n]) > 1 - a, 

and let A n (a) be the smallest eigenvalue of the submatrix of I—K n indexed by states 
0,..., M n (a) — 1. Set 

u n (a) = E org (a) , v 2 (a) = Var O r£ (o) . 

Assume that 7r ra (0) —>• 0. Then, the following are equivalent. 

(1) Fff has a total variation cutoff. 

(2) u n (a)/v n (a) —> oo for all a £ (0,1). 

(3) u n (a)X n (a) —> oo for all a £ (0,1). 

(4) There are a £ (0,1) and a positive sequence {t n ) < ^L 1 satisfying 

t n =0(u n (c)), Vce(0,1) 

and 

Jirr^Po (V£ (a) > (1 - e)i„) = 1, Ve G (0,1), 

and, for any b £ (a, 1), there is ab £ (0,1) such that 

limsupPo (r^\ b) > (1 + e)t n ) < a b , Ve > 0, 

where Pj denotes the probability given the initial state i. 

Furthermore, if (2) or (3) holds, then Ff has a cutoff with cutoff time (u n (a))^ =1 
for any a £ (0,1). If (4) holds, then Tf has a cutoff with cutoff time ( t n )£L 1 . 

The discrete time version of the previous theorem can be stated as follows. 

Theorem 5.2. Let F, M n (a), A„(a) be as in Theorem 15.11 For n > 1, let T- n ^ be 
the first hitting time to state i of the nth chain in F and, for a £ (0,1), set 

u n {a) = Eorg (a) , w 2 n {a) = Var 0 T^ (a) . 

Assume that 7r n (0 ) —> 0, infj iH K n (i, i) > 0 and u n (a) -> oo for some a £ (0,1). 
Then, the conclusion in Theorem 15.11 remains true for the family F L . 

Remark 5.1. One can see from the proof of Theorem IS.ll that the condition 7r ra (0) — > 
0 is necessary for the existence of cutoff of Ff‘. This is also true for the family F L 
in Theorem 15.21 

Remark 5.2. Let F,F C be as in Theorem O and ( Pn,i,Qn,iii'n,i ) be the transition 
rates of the nth chains in F. Let M n £ X n be a sequence of states satisfying 
that is, 

inf 7r„([0, M n \) > 0, inf 7r„([M„,n]) > 0, 

n >1 n >1 

and x n £ {0,n} be a boundary state fulfilling the following equation 

max{E 0 r^, E „r^ } = E Xn r^. 
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By Lemma [A. II and Theorem A.l of If], if x n = 0, then 


E 


1 /rrv -1\ M n 1 i 

MIM) . ^ 1 


= y^ F„ U U, < y^ 


and 


^_q '^n(j'^)Pn,i ^_q / Kn(S)Pn,i 


M n — 1 


— > min{7r„([0,M„]),7r„([M n ,n])} x max V' 

A77, j’-j<Mn ^ny^jPn.i 

i=3 ' ’ 


M n —1 


> min{7r„([0,M„]),7T n ([M„,n])} x 7r„(0) ^ - 

i=0 ’ Kn \ l )P n , 


This implies 

117 ~(«) \ < ___ 

Xn Mn n ~ min{7r n ([0,M„]),7T„([M„,n])}7r„(0)' 

In a similar way, this inequality also holds in the case x n = n. As a consequence of 
Theorem 11.41 if T c has a maximum total variation cutoff, then ir n (x n ) —> 0. The 
above discussion also holds for J- with the assumption inf n> j K n (i, i) > 0. 


Remark 5.3. Let and T L be the families in Theorems 15.II and 15.21 If Jqf (resp. 
J- L ) has a total variation cutoff with cutoff time t n , then 

t n ~ E 0 r^, (resp. t n ~ E 0 t^ ,) 

where M n £ X n is any sequence satisfying 


(5.1) 


inf 7 t„([0,M„]) > 0, 

n> 1 


inf n n ([M n ,n]) > 0. 

n> 1 


In particular, if JF^ (resp. J- L ) has a total variation cutoff with bounded cutoff 
time, then 

E or ( M n = 0(1), (resp. E 0 r[^ = 0(1),) 
for any sequence M n £ X n satisfying (ED. 


Remark 5.4. Let be the family in Theorems 15.11 If Fj? has a total variation 
cutoff, then u n (a) ~ u n (b ) for all a,b £ (0,1), or equivalently 

e m„(«)S W = o (e 0 t 2 (c) ) , Vo, b,c£ (0,1). 


This is also true for T L with the assumption in Theorem E3 But, the converse is 
not necessarily true. For an illustration, recall the example in Remark 11.71 It has 
been proved that 


E 0 r 


(n) 


1 


M »(“) ~ A n 
By Lemma lA.il one may compute 


1 

Tn 


Va£ (0,1). 


Var Q r[ n) 


1 

T 

s n 


and 


Var l r M,! 


(a) — 


M n (a)-1 

E 

2 — 1 


1 


K n (i, i + i)ir n (i) 


1=1 


^mM +1 
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Along with the fact Var 0 T^ < (E 0 r^) 2 , we may conclude from the above compu¬ 
tations that Var 0 rj^/j X £“ 2 + n 4 for all a £ (0,1). By Theorem 15. II this implies 
that the family Tf has no total variation cutoff. It has been shown in Remark 11.71 
that if ?r 2 £„ — > 0, then , ~ for all a £ (0,1). 

Remark 5.5. Let v n (a) and w n (a) be the constants in Theorems 15.11 and 15.21 It 
is remarkable that if S = inf i, n K n (i,i) > 0, then 5v^(a) < w 2 (a) < u 2 (a) for all 
a £ (0,1). To see this, we let p[ n \ be the eigenvalues of the submatrix of 

I — K n indexed by 0,..., M„(a) — 1. By Lemma [2711 /C-* > 0 for all i and 


M n (a) 

«n(“) = E 


2—1 


1 

Wr’ 


M n (a) 

«£(«) = E 

2=1 


i-4 w) 

{Pi n) Y 


Clearly, ic 2 (a) < w 2 (a). For the lower bound of u; 2 (a), set = (K n — 5I)/(l — 5). 
Note that is also a stochastic matrix and the submatrix of I — indexed 
by 0, ..., M n (a) — 1 has eigenvalues /^"^/(l — <5), ■ ^M n ( a )/Y- ~ £)■ By Remark l2Jl 

we have 


M n (a 

a-«) £ 


a (ft 1 " 1 ) 


M„(a) 

> E 


i—1 


1 



and this implies wf(a) > Sv^fa). 


Remark 5.6. Note that, in Theorems o and 15.21 if one chooses E 0 r|"^ a ^ and 

Eo t m\q) as the cut °ff times, the square roots of Varorj^^ and Var 0 are no 
longer suitable for the respective cutoff windows. This is very different from the 
conclusion in Theorem [LH and we refer the reader to Example [5J] for an illustration 
of this observation. 


The next corollary provides a way of selecting cutoff windows. 

Corollary 5.3. Let J 7 Cl u n (a),v n (a) be as in Theorem, 1 5. 11 If Tf has a total vari¬ 
ation cutoff and b n > 0 is a sequence satisfying 

b n = o(u n {a )), v n (a) = 0(b n ), VaG (0,1), 

then T]f has a ( u n (a ), b n ) total variation cutoff. The above statement is also true for 
J- L under the assumption of inf nj! ; K n (i , i) > 0 and inf„ b n > 0 and the replacement 
of v n (a) by w n (a) in Theorem 15. 2\ 


Example 5.1. Let T = {X n ,K n ,TT n )fL^ be a family of birth and death chains for 
which X n = {0,1,..., n}, n n (i) = 2 _n (”) and 


K n (i,i + 1) = 1- i 
K n [M„, M n + 1) = c n 
K n {M n + 1, M n ) = fA 


K n (i + 1, i) = for * ^ M n , 

(1 - , K n (M n , M n ) = (1 - Cn) (1 - *£) 

Kn(M n + 1, M n + 1) = (1 ~ C " ) <, M "+ 1) , 


(M„ +1) 


where c n £ (0,1) and M n £ X n is a state satisfying 7r n ([0, M n ]) > 1/4 and 
Tr n ([M n ,n]) > 3/4. Let T c be the family associated with T and r- n 1 be the first 
hitting time to state i of the nth chain in fF c . We will also use M n (a) with a £ (0,1) 
to denote a state satisfying 7r„([0, M n {a)}) > a and ir n ([M n (a),n\) > 1 — a. When 
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c n = 1, (X n , K n , Tr n ) is the Ehrenfest chain on {0,1,..., n}. The spectral informa¬ 
tion of the Ehrenfest chain is well-studied and it is easy to derive by Lemma, 12.2 
that 


Ei 


^ r Ln/2j = ^ nl °g n + °( n )> Var 0 r L n/2j ~ '* • 

One may use Stirling’s formula to show that, for 0 < a < b < 1, 

71 1 

- M n (a) x y/n, 7 T n (i) X —= uniformly for M n (a) <i< M n (b). 

2 ' y/n 

By Lemmas lA. 11 12.21 and 17.11 this implies that, for a £ (0,1), 


1 


“(O 


(5.2) 


E o t mm = 7 nl °S n + 0(n), Var 0 t™ ( o) X n 


1 


(n) 


When c n is small, {X n , K n , ir n ) is the modification of the Ehrenfest chain with 
bottleneck between states M n and M n + 1. In the following, we will discuss the 
total variation cutoff and the cutoff window of Tf when c n is small. 

First, we consider the total variation cutoff of Tf. By Lemma [A.II and (15.21) . 
one can show without difficulty that, for a £ (0,1/2), 


(5.3) 


E o t m’ ( o) = jnlogn + 0(n), Var 0 r/” 


(n) 


(a) 


and, for a £ (1/2,1), 
(5.4) (n) 


=r l0gn+o( ”)+ 2 ///«„) ■ v “y2m * ” 2+ i 


where n n (M n ) x 1 /y/n. By Theorem 15.11 T/ has a total variation cutoff if and 
only if c n y/n log n —> oo. 

Next, we discuss the cutoff window of Tf. Assume that c n y/n.\ogn oo. By 
Corollary 15.31 and Equations (15.31) and (15.4)1 . T 1 / has a ({n log n, max{ y/n/c n , n}) 
total variation cutoff. We will prove that the window is optimal when c n yfn. —> 0. 
Suppose c n yfn —> 0 and set 


s n = Eqt^, t n = E 0 TmI + 1 , a 2 n = Var £ n) T (n) 


, 1,2 _ v (n)~(n) 

0 'M n > u n — Vcll 0 t M„ + 1- 


Let T/ TV (0, e) be the total variation mixing time of the nth chain in Tf and recall 
(17.21) in the following 

< E 0 r J ( n) + /(i^)Var 0 (ff (n) ) for e = 6 + 7r„([* + 1, n]) 

> E 0 ff (n) - yj (yzy)Varo(r( n) ) for e = <5 - tt„([0 ,i - 1]) 

In the first inequality, the replacement of i = M n and (5 = 1/8 implies 


p( c ) 

L n, TV 


(0,e) 


T„ c , xv (0, 7/8) < s n + 3a n . 

In the second inequality, the replacement of i = M n + 1 and <5 = 3/8 gives 

T n,Tv(M/ 8 ) >tn- £ b n . 

These two inequalities yield 

T n,Tv(°> V 8 ) - r„ c ,Tv(0,7/8) > E m „7^ +1 - 3a « - ^b n . 
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Under the assumption that c n y/n —> 0, one may compute using Lemma TA. II that 

\fn n 
C-n C n yfn 


E 


'M n T Mri + 1 


Consequently, when c n y/n —> 0, the cutoff window can be Varofor any a £ 
(1/4,1) but not for a £ (0,1/4). Similar observation also happens in F R . 

We would like to point out an interesting observation arising from the bottleneck 
effect in this example. Compared with the case c n = 1 for all n, when c n is of order 
bigger than 1 / y/n, F L has a cutoff with the same cutoff time and window. When c n 
is of order between 1 /y/n and 1 /y/n log n, F/f has a cutoff with the same cutoff time 
but different (larger) cutoff window. When c n is of order smaller than 1/ y/n\ogn, 
the cutoff of F/ disappears. 


The proofs of Theorems 15.11 and 15.21 and Corollary 15.31 are complicated and are 
given in Section [7] 


6. Comparison of total variation cutoffs 

In this section, we make a comparison of cutoffs introduced in Sections [3] and 
[5] To avoid confusion, we use F, F c to denote families of birth and death chains 
without initial states specified and let F h , Ff and F r ,F/ be families of chains 
started at respectively left and right boundary states. The following theorem is an 
immediate corollary of Theorems 15.11 and 15.21 and the proof is given in the end of 
this section. 

Theorem 6.1. Let F = (X n , K n , 7r n )))T 1 be a family of irreducible birth and death 
chains with X n = {0, ...,n} and F c be the family of continuous time chains asso¬ 
ciated with F. For any sequence S = (x n )%L 1 with x n £ X n , let X s , F/ be the 
families of chains in J-, T c for which the nth chain started at x n . 

(1) If Tf and F R have a total variation cutoff with cutoff time r n and s n , 
then fF c has a maximum total variation cutoff with cutoff time t n , where 
t n = max{r„, s n }. 

(2) Let M n £ X n be a sequence of states satisfying 

inf ir n ([0,M n ]) > 0, inf n n ([M n ,n]) > 0 

n>1 n> 1 

and let S = (r„)“ =1 , where x n £ {0,n} is a state such that 
max |e 0 t^ , E„f^ j = E Xn r^ 

and 7y n is the first hitting time to state i of the nth chain in IF C . If J- c has 
a maximum total variation cutoff with cutoff time t n , then Ff has a total 
variation cutoff with cutoff time t n . In particular, F R has a (E Xn r^,6„) 
total variation cutoff with b\ = max{Varor^\ Var n T^ }. 

The above statements also apply for F under the assumption \rd n ^K n {i,i) > 0. 

Remark 6.1. Let F c ,T- n \ M n (a) be as in Theorem 15.11 By Theorem 16.1( 21 and 
Remark 15.41 if F c has a maximum total variation cutoff, then 

EM„(a)T^ (6) = O (max {e 0 t^ (c) ,E 0 t^ ( c) }) , Va, b,c£ (0,1). 
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The following example gives counterexamples to the converse of (1) and (2) in 
Theorem 16.11 

Example 6.1. Consider the family T = (X n , K n , 7r n )^L 1 , where X n = {0,1, ...,n} 
and 

{ K n (i, ^ T 1) — 1 2 n ’ ^0 — i ^ 7X, i 7^ ini 

+ l,i) = ^i, VO < i < n — 1, i ^ i n , K n (n,n - 1) = 1, 

^n(in i in T 1) — (1 2 ^); Kn (in T U 7 n ) — C 71 2n 7 

K n (i n ,i n ) = (1 - c„)(l - i^), jr n (i„ + 1,*„ + 1) = (1 - c„)%±±, 

with 0 < i n < n and c n £ [0,1], and 

7 T n (i) = 2 1 ~ 2n ^ 2 ^ , VO < i < n, 7r n (n) = 2 _2n 

As before, we use M n (a ) to denote a state in satisfying 7r ra ([0, M„(a)]) > a 
and ^([M^a), n]) > 1 — a and let be the first hitting time to state i of the 
continuous time chain associated with (X n , K n , ir n ). Let 0 < A n p < X n .2 < ••• < 
An,n be eigenvalues of I— K n . It follows immediately from the central limit theorem 
that 

(6.1) n — M n (a) x y/n, Vo G (0,1). 

In what follows, we discuss the total variation cutoffs of T c . Jyf and with 
specific c„ and i n . 

First, assume that c n = 1 for all n. In this setting, the chain (X ni K n , Tr n ) 
is exactly the collapsed chain of the Ehrenfest model on {0,1,..., 2n} obtained by 
combining states {*, 2 n — i} into a new state for 0 < i < n. The spectral information 
of the Ehrenfest model is well-studied and this implies 

2i 

Xn i = ; VI ^ i ^ 71. 

n 

By Theorem 11.11 T c has a maximum separation cutoff with cutoff time An log n 
and, thus, has a maximum total variation cutoff. A simple computation with the 
Stirling formula gives 

7 r n (i) x ——, uniformly for M n (a) < i < n. 

\Jn 

By Lemma [A. 11 this implies that, for a £ (0,1), 

X n ’ Var n^M„(a) - n 2 , 

and, by Theorem 11.31 we have Eot^\i ~ ^nlogn for any a £ (0,1). As a 
consequence of Theorems 15.II and 16.11 21. has no total variation cutoff, but 
has with cutoff time ^nlogn. Furthermore, by Theorem 16. 11 1), the total variation 
cutoff time for F c can be ^nlogn. This gives a counterexample to the converse of 
Theorem 16.11 1). 

Next, we consider the case n — i n = o(^/n) and c n is small. The second as¬ 
sumption means that a bottleneck arises between states i n and i n + 1. Under the 
first assumption, m implies that, for a £ (0,1), both E 0 r|^ a) and Var 0 T^^ 
remain the same as in the case c n = 1. This implies that Jyf has a total variation 
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cutoff with cutoff time ^nlogn. For the cutoff of T^, one may compute using the 
formula in Lemma lA.il that, for any a £ (0,1), 


Consequently, Theorem 15.11 implies that Tff has no cutoff in total variation. More¬ 
over, Theorem II.41 implies that if (n — i n )/c n = o(?rlogn), then T c has a maximum 
total variation cutoff. If nlogn = 0((n — i n )/c n ), then T c has no maximum total 
variation cutoff, which gives a counterexample to the converse of Theorem 16. 11 21. 

The next theorem provides more information on the comparison of cutoffs and 
should be regarded as a complement to Theorem 16.II 

Theorem 6.2. Let T = {(X n , K n , Tr n )^L 1 be a family of birth and death chains 
with X n = {0,1, ...,«} and T c be the family of continuous time chains associated 
with T. Suppose that, in total variation, Jqf has a cutoff with cutoff time t n but 
no subsequence of Tff has a cutoff. Let M n be a state in X n and set 

E 

R = limsup " Mn , Va £ (0,1). 

n—loo t n 

Then, the following are equivalent. 

(1) T c has a maximum total variation cutoff. In particular, t n is a cutoff time. 

(2) R = 0 for some sequence (M n )'^L 1 satisfying 

(6.2) inf 7 t„([ 0,M„]) > 0, inf n „([M„,n]) > 0. 

n >1 n >1 

(3) R = 0 for any sequence (M„)^L 1 satisfying (16.21) . 

The above statement also holds for T provided m{ n ^ K n (i,i) > 0. 

Proof. We first consider the continuous time case. Since Tf has a total variation 
cutoff with cutoff time t n , Theorem 15. II implies 

(6.3) E 0 r^l {a) ~ t n , Var 0 ?^ (Q) = o(t 2 n ), Va £ (0,1). 

Under the assumption of (16.21) . one may choose 0 < a < b < 1 such that M n (a) < 
M n < M n (b). By (16.31) . this implies 

(6.4) E 0 t ( mI ~ tn, Var 0 f^ = o{t 2 n ). 

(3)=>(2) is obvious. Now, we prove (2)=>(1) and assume that (2) holds. Note 
that R = 0 is equivalent to E, n r^ = o[t n ). This implies Var= o(t 2 ) using 
the fact Var„rj n ' > < (E„r|"^) 2 . Along with (16.41) . we may conclude 

(6.5) ymax { Var 0 T^, Var} = o (max |e 0 t^ , E n r^ }) . 

By Theorem ll.4l T c has a maximum total variation cutoff with cutoff time t n . 

For (1)=>(3), we prove the equivalent implication by assuming that R > 0 for 
some sequence ( M n )£L 1 satisfying (16.21) . Since R > 0, we may choose a subsequence 
{kn)ffLi such that 


^” T M„ (a) 


n - 



(6.6) 


t kn = O (E . 
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As the subfamily of Tff indexed by ( k n )^L 1 is assumed to have no total variation 
cutoff, we may refine, by Theorem 15. II the selection of k n such that 

( 6 - 7 ) l/Var knT^tl - ^TmII ■ 

Combining (16.41) with the above discussion leads to 

\j max {Varor^, Var } x max {e 0 , E fc „?^ } . 

By Theorem 1 1.41 the subfamily of JF C indexed by (k n ) has no maximum total vari¬ 
ation cutoff. 

Next, we consider the discrete time case. (3)=>(2) is clear. For (2)=>(1), assume 
that R = 0 for some sequence M n satisfying m - Observe that 

(6.8) E 0 r$ n + E n T$ n > n. 

By Remark 15.31 (16.81) implies t n —> oo. Using Theorem 15.21 one may derive a 
discrete time version of (16.31) . (16.41) and (16.51) . As a consequence of Theorem ll.4l T 
has a maximum total variation cutoff with cutoff time t n . 

For (1)=>(3), we assume the inverse of (3) that R > 0 for some sequence M n 
satisfying (16.21) . Consider the following two cases. 

Case 1: tk n —> oo for some subsequence k rl . 

Case 2: tk n =0(1) for some subsequence k n . 

The proof of Case 1 is the same as the continuous time case. For Case 2, since 
the subfamily of T L indexed by (k n ) has a cutoff with cutoff time tk n , Remark 1 5.3 1 
implies that 

E° = 0(1), Var 0 = 0(1). 

By (16.81) . we have E k n T M^ => 00 an d, by Theorem 1 5.2 1 we obtain a discrete version 
of (16.61) and then (16.71) . Consequently, Theorem ll .41 implies that J- has no maximum 
total variation cutoff. □ 

The next theorem is a special version of Theorem l6.1l which identifies two different 
cutoffs discussed in this section. 

Theorem 6.3. Let J- = (Tf n , K n , 7r„)^ =1 be a family of irreducible birth and death 
chains with X n = {0, ...,n} and T c be the families of continuous time chains as¬ 
sociated with T. Assume that K n (i,j) = K n (n — i,n — j) for all i,j £ X n and 
n> 1. 

(1) Jy' has a total variation cutoff with cutoff time t n if and only if T c has a 
maximum total variation cutoff with cutoff time t n . 

(2) Under the assumption that inf n> i K n (i,i) > 0, J- L has a total variation 
cutoff with cutoff time t n if and only if J- has a maximum total variation 
cutoff with cutoff time t n . 

Proof of Theorem \ 6. IV Continuous time case). As before, we use fj n to denote the 
first hitting time to state i of the nth chain in fF c and use the notation M n (a) with 
a £ (0,1) to denote a state in X n satisfying 7r n ([0, M n (a)]) > a and ir n ([M n (a), n]) > 
1 — a. 
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For (1), assume that have total variation cutoffs with cutoff times r n ,s n - 

By Theorem 15. II we have 


^/Var 0 r^(i/ 2 ) = o (e 0 t£ (1/2) ) , E 0 rg (1/2) ~ r n 


and 


^/Var» t^(j/ 2 ) — o ^En'r^fi( 1 / 2 )) > 


E, 


n ' M n (1/2) 


Clearly, this implies 


ymax {var 0 r^j (1/2) , Var n r£ (1/2) } = o (max {E 0 rg (1/2) , E„t£ (1/2) }) 

and 

max (e 0 t^ (1 /2 ) ,E„t^ ( 1/2) | ~ max{r„, s n } = t n . 

By Theorem II.41 T c has a maximum total variation cutoff with cutoff time t n . 

For (2), let T = (X n , K n , n n )^ =1 be a family given by 

K n = A n , T n = T n if X n = 0, 

and 

K n (i,j) = K n (n-i,n-j), Tr n (i) = TT n (n - i), Vi,j€X n if x n = Ti¬ 
bet J- c be the family of continuous time chains associated with J-. Suppose that 
T c has a maximum total variation cutoff with cutoff time t n . It is obvious that J~ c 
also has a maximum total variation cutoff with cutoff time t n and, to show that 
J-S has a total variation cutoff with cutoff time t n , it is equivalent to prove that 
has a total variation cutoff with cutoff time t n . 

Let r) be the first hitting time to state i of the continuous time chain associated 
with (X n , K n ,7r n ) and set M n be a state defined by 


M n = 


M n if x n = 0 
n — M n if x n = n 


We use M n (a) to denote a state such that 

7 r n ([0, M n (a)\) > a, w n ([M„(a), n}) > 1 - a. 

By Theorem 11.41 the total variation cutoff of T c with cutoff time t n implies 


t n ~ max {Eot^~' ) , E n r^ \ = Eor- 

L M n j J 


(n) 

M n 


and, for any a € (0,1), 
(6.9) 


\/max{varofg (Q) ,Var„fg (o) } = o(t n ) = o (e 0 rg) . 
As a result of Lemma rm and (EH , we have, for 0 < b < a < 1, 

E MnW ? 2(a) = ° (\/ Var M.W f 2(a)) = ° ( E ° ? 2) ’ 


which leads to 


~ v “ £ < 0 ’^ 
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Applying the last identity to (16.911 yields 

^/ Var0? Si(a) = O ( E ° ? 2(a))’ 

By Theorem 15.11 has a total variation cutoff with cutoff time t n . The precise 
description of the cutoff time and window is given by Theorem 11.41 Corollary 15.31 
and Remark 11.51 □ 

Proof of Theorem 1 6. 1\ 'Discrete time case). We use t-" 1 to denote the first hitting 
time to state i of the nth chain in J- and M n (a) for a state in X n satisfying 
ir n ([0, M n (a)]) > a and n n ([M n (a), n]) > 1 - a. 

For (1), assume that JF L ,T R have cutoffs with respective cutoff times r n ,s n . 
Given an increasing sequence K. = in {1,2,...}, let T(1C) be the family 

of chains in J- indexed by the sequence 1C. By Proposition 2.1 in [5], to prove J- 
has a maximum total variation cutoff, it suffices to show that, for any increasing 
sequence of positive integers, there is a subsequence, say /C, such that P(JC) has a 
maximum total variation cutoff. Note that, by Remark 15.31 r n + s n must tend to 
infinity. This implies that K. can be chosen to satisfy one of the following cases. 
Case 1: rk n —> oo and Sk n —> oo. 

Case 2: rk n —> oo and Sk n = 0(1). 

Case 3: rk n = 0(1) and Sk n —> oo. 

The proof for Case 1 is the same as the continuous time case. The proofs of Case 
2 and Case 3 are similar and we discuss Case 2, here. By Theorem l5.2l and Remark 
15.31 the cutoffs of T L , T R imply that, for a € (0,1), 

E ° T M*1 (a) ~ r *» > \/ Var 0 T M^( a ) = °( r kn ), 

and 

{/var k n T { Mll{ a ) ^ E knTM? n (a) = °(!)• 

This implies, for a e (0,1), 

\j max { Var o (a) , Var fcn(q) } = o (max {E 0 r^ (o) , E kn r ^ (a) }) 

and 

max{E 0 T M^ (a ), E k n r^ (a) } ~ max{r fc „,s fen } = t kn . 

By Theorem 11.41 J-(K) has a maximum total variation cutoff with cutoff time tk n - 
For (2), based on the following observation 

n < Eot^ + E n T- n \ VO < i < n, 

we have E —> oo. The remaining proof is similar to the continuous time case 
and is skipped. □ 

7. Proof of Theorems 15.1115.21 and Corollary 15.31 

This section is dedicated to the proof of Theorems 15.11 and 15.21 and we need the 
following lemmas. 
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Lemma 7.1. Let (X,K,tt) be an irreducible birth and death chain on {0,1, ...,n} 
and Ti,Tt be the first hitting times to state i of the discrete time chain and the 
associated continuous time chain. Let Aj be the smallest eigenvalue of the submatrix 
of I — K indexed by 0,..., i — 1. Then, for i < j, 


r(M) 


-(E iTj) 2 < Var i(Tj) < —E,r, 


27T([0,j-l]) V ^ 3> ~ 01 ^ \j 3 


and 


27r([o!/-l]) (ElTj)2 - Vari(Ti) - 


where S = min, K{i, *). In particular, 


Ej Tj = E iTj < 


4tt([0, j - 1]) 
7r([0,*])Aj 


Lemma 7.2. Let K be the transition matrix of an irreducible birth and death chain 
on {0,1,..., n} and Ti be the first hitting time to state i for the continuous time chain 
associated with K. For 0 < i < n and a £ (0,1), 

Po(ri > aEori) > min (e _v/ “, J' - 

l v a + l 1 _ 



Lemma 7.3. Let K be the transition matrix of an irreducible birth and death chain 
on X = {0,1,..., n} with transition rates pi, qi, Vi and stationary distribution i r. Let 
Ti , Ti be as in Lemma Then, for i < j < k, 


E j min{r„ T k } = Ej min{T„ T k } = A/B, 


where 


*= E 

z+l<^l<j 

j<l 2<fc-l 


n(£ 1 )qe 1 Tr{e 2 )Pi 2 ’ 


S = E 


i 

7 r(£)pt 


Lemma 7.4. Let (X,K,n) be an irreducible birth and death chain on {0,1, ...,n} 
and H t = e~ t ( I ~ K \ Then, 

(1) H t ( 0, i)/n(i) > H t ( 0, i + l)/n [i + 1) for 0 < i < n and t > 0, 

(2) Assume that min; K(i, i) > 1/2. Then, K m (0,i)/n(i) > A' m (0, i + l)/7r(z + 
1) for 0 < i < n and m > 0. 

We relegate the proofs of Lemmas 17.1117.21 and 17.31 to the appendix and refer the 
reader to Lemma 4.1 in [12] for a proof of Lemma 17.41 


Proof of Theorem \5.1\ We first prove the equivalence for cutoffs. Note that 7r ra (0) 

0 is necessary for the total variation cutoff since 

lim inf d^\ v (0, t) < lim inf d^ TV ( 0,0) = 1 — lim sup 7r„ (0). 
n-y OO ’ n-y oo ’ n^yoo 

Under the assumption that 7r n (0) —> 0, it is easy to see that, for any a £ (0,1), 
M„(a) > 1 if n is large enough. For a £ (0,1) and n > 1 such that M n {a) > 1, we 
let 


A n ,i(a) < • • • < A n ,M n (a){0-) 
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be the eigenvalues of the submatrix of I — K n indexed by 0,1, M n (a) — 1. Clearly, 
A n (a) = \ n ,i(a) and, by Lemma T2. II 


M n (a) 


M n (a) 


»(°)= E 


2 = 1 ’ 

As in the proof of flUD , we have 


;(«) = E 


fe X n,MY 


\/Un{a)X n (a) < Un ^ < u n (a)\ n (a). 
v n (a) 

This implies the equivalence of (2) and (3). 

(c) 

To prove the remaining equivalences, we let d n TV be the total variation distance 
of the nth chains. By Lemma T3.11 one has 

< Po(E } >t)+ 7r n ([* + 1, n]), 


(7.1) 


l n, TV 


(o,t) 


> P 0 (r( n) >t)~ 7r n ([0, i - 1]). 


As a result of the one-sided Chebyshev inequality, this implies 


(7.2) T<$y(0,e) 


< E 0 T- n) + ^ (i^)Var o(T,- n) ) for e = 6 + ir n ([i + 1,n]), 
> E 0 rf n) - yj ( r zy)Var 0 (?) (n) ) for e = 6 - tt„([0, i - 1]), 


where <5 £ (0,1). 

Now, we prove (2)=>(1) and assume that (2) holds. By the last inequality of 
Lemma rm we have, for 0 < 5 < e < 1, 

(7.3) 0 < u„(e) — u„(S) < 


4ev n (e) 

< --— = o{u n {e)). 


S A„(e) S 

Fix e £ (0,1) and let 0 < e\ < e < £2 < 1. By (17.21) . the replacement of i = M„(e 2 ), 
5 = e 2 — e in the first inequality and the replacement of i = M n (e 1 ), (5 = 1 — e + e\ 
in the second inequality yield 

^iv(°. 1 - e) < u n {e 2 ) + ~ l)v„(e 2 ) = (1 + o(l))u„(e 2 ), 

k T i?Tv(0,1 - e) > u„(ei) - ^/(^ - l)r'n( e i) = (1 + o(l))u„(ei). 

As a result of (17731) . we obtain that T^ v (0, e) = (l + o(l))u„(? 7 ) for any e, r] £ (0,1), 
which proves (1). 

Next, we prove (4)=»(3). Assume that (t n )%L 0 is a positive sequence satisfying 
t n = 0(u n (c)) for all c £ (0,1) and a £ (0,1) is a constant such that 


(7.4) 


( r 2(&) > (1 “ =1 ’ VbG 


and, for any b £ (a, 1), there corresponds a constant a b £ (0,1) such that 
(7.5) lim sup P 0 (r^\ b) > (1 + e)t„) < a b , 

n .—^no \ n\ ) / 


for all e £ (0,1). Note that A„(a 2 ) < A„(ai) for 0 < ai < a 2 < 1. To prove (3), it 
suffices to show that t n X n (b ) -A 00 for all b £ (a, 1). Now, we fix b £ (a, 1). Since 
7r„(0) -A 0, it is clear that M n (b) > 1 for n large enough. By [3], if M n {b) > 1, we 
may write = T n (6) + S n (b), where T n (b) and S n {b ) are independent, T„(b) 

is an exponential random variable with parameter X n (b) and S n (b) is a sum of 
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independent exponential random variables with parameters X n , 2 (b),X n ,M n (b)(b). 
Note that 

Po (rg (6) > (1 - e)tn ) = / \n(b)e- x ^ b)s P 0 (S n (b) > (1 - e)t n - s)ds 

< (1 - e- A "W t )P 0 (5„(&) > (1 - e)t n -t) + e- A »< 6 >*, 

where the inequality is obtained by separating the region of integration into (0 ,t) 
and [i, oo), and 

Po () > ( X + e )^J = J X n (b)e~ XnWs P 0 (S n {b) > (1 - e)t n - s)ds 
>Po (S n (b) > (1 + e)t n -r)e~ x ^ r . 

By (17.41) and dm the replacement of t = C/X n {b) and r = 2C/X n {b) with C = 
\ log A- in the above inequalities yields that, for all e £ ( 0 , 1 ), 

lim P 0 (S„( 6 ) > (1 - e)t n - C/X n {b)) = 1 

n—> oo 

and 

lim sup Po (Sri (b) > (1 + e)t n - 2C/X n [b)) < y/a^ < 1 . 

n—¥ oo 

As a consequence, for e £ (0,1), if n is large enough, one has 

(1 + e)t n — 2C/X n (b) > (1 — e)t n — C/X n (b), 

which implies t n X n {b) > C/(2e). This proves t n X n (b) —»• oo. 

To finish the proof of those equivalences, it remains to show (1)=>(4). Assume 
that T c has a cutoff with cutoff time t n . The replacement of * = M n (a ) in (ED 
implies that, for all e £ ( 0 , 1 ), 

(7.6) (f£(a) > i 1 ~ > a 

and 

(7.7) lim sup P 0 (r^\ a) > (1 + e)t n ) < a. 

By the Markov inequality, (17.61) implies that t n = 0(u n (a)) for all a £ (0,1). As a 
result of Lemma [A2J (17.71) implies that u n (a) = 0(t n ) for all a £ (0,1), which leads 
to t n x u n (a) for all a £ ( 0 , 1 ). 

To fulfill the requirement in (4), one has to prove that there is a £ (0,1) such 
that 

( 7 - 8 ) J ™/ 0 (r£!(a) > (! - £ )^) = !. Ve £ ( 0 , 1 ). 

To see the above limit, we fix e £ (0,1) and show that, for any subsequence of 
positive integers, there is a further subsequence satisfying m - Let k n be a sub¬ 
sequence of positive integers and set 

R(a) := limliminf EMfcn(a)TMfc " (b) . 

b —>1 n—>co tk n 

Clearly, R(a) is nonnegative and non-increasing in a. 

We consider the following two cases of R(a). First, assume that R(a) = 0 for 
some a £ (0,1) and let b n be a sequence in (a, 1) that converges to 1. Since 
R(bi) = 0, we may choose £ {Aq,fc 2 ,...} such that 8 ^( 0 )^^^) < i^i/2. 
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Inductively, for n > 1 , we may select, according to the fact R(b n - t-i) = 0, a constant 
4+1 £ {ki, fo, •••} satisfying t n +\ > t n and 


This implies 

e (a, 1 ). 

By Lemma l2d~l u n (a) x t n implies 1/A„(a) = 0{t n ) and, by Lemma l7.ll this yields 
Var Mc n (a)^M^\b) = °(te n ) f° r all b £ (a, 1). As a consequence of the one-sided 
Chebyshev inequality, we obtain 

(jM? n (b) - rttn) = !. V& £ (a, 1), 77 > 0. 


This leads to 

(^(a) > (! - 

- 1 ™> i cS fF ’ 0 ( ? £i(b) > (! - e/fytn’TMtlw ~ ^ et *n/ 2 ) 

= 1 ™S fP ° (^( 6 ) > (! - e/ 2 )t/„) > 4 

for all 6 £ (a, 1), where the last inequality uses (17.61) . Letting b tend to 1 gives the 
desired limit. 

Next, we assume that R(a) > 0 for all a £ (0,1). Along with this fact u n (a) X t n 
for all a £ ( 0 , 1 ), it is easy to see that, for any a £ ( 0 , 1 ), there is 6 £ (a, 1 ) such that 
^•M kn (a)^Mk\b) x tk n - To prove (17.81) for the subsequence k n , we need the following 

discussion. For n > 1, set H„ jt = e~ t ( I ~ Kn ' > and let (A4,j)t>o be a realization of 
the semigroup H n j and, for ij £ ( 0 , 1 ), let 


N n (rj) = max{0 < i < n|fl'n,( 1 -^)t n (0,i) > 7 r„(i)}. 

By Lemma 17.41 we have 

^tv(0, (1 - v)tn) = H n ,{ i-^)t„(0, [0, N n (rj)}) - 7 r„([ 0 , iV n (ry)]). 
Since T c has a cutoff with cutoff time (t n )^ =1 , this implies 


lim H )t {0, [Q,N n {r])]) = 1, lim 7 r„([ 0 , N n (rj)]) = 0. 


Obviously, this yields 

(7.9) lim P 0 (X n (1 _ )t < M n (a )) = 1, Va, 17 £ (0,1). 

n—Vrvi \ i\ 1/ / 


Back to the case that R(a ) > 0 for all a £ (0,1), one may choose 0 < b < a < 
a < a + < c < 1 such that 

(T10) ®' M fc n (b) T M fcn \a-) X tk n X ®M fen (a+)' r M fc j( c )- 

This implies that Mk n (b) < Mk n (a~) and Mk n (a + ) < Mk n {c) for n large enough. 
Next, let L be a positive integer and set 


A n = A „(L) 


(1 - e)t n 


L 
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Note that, for 0 < j < L — 1, 

p 0 e U^k n , (j + l)AfcJ,^fc n ,(j + l)A fe „ ^ M kn (b)) 

<Po ( T Mfe n \a) e U + ^Mt n (a) ( T M fc „\b) — ' 

By (17.91) . summing up the above inequalities over j and then passing n to the 
infinity yields 

limsupPo (T^\ a) < (1 - e)ifc B ) 

n—>oo v 7 

<limsupPo (^^(a) < (! - e )^n) X limsupP Mfefi(a ) (r£ n) (b) < A fc „) . 

Observe that if there is L > 0 such that 

(7.H) limsupP MfeJa) (r^ (b) < < 1, 

then 

limsupPo ^ (! - e)4 n ) = 0, 

as desired. To get the limit in (17.111) . it suffices to show that there is L > 0 such 
that 

lim sup P M kn (a) (Tk n < A fcn ) < 1, 

n—¥oo 

where T n = min{T^ (b) ,By Lemma [773] E M kn ( a )T kn = A kn /B kn , where 


— 


E 


Tin ([£ 1 ,^ 2 ]) 


M n (b) + l<^i<M n (a) 
M„(o)<< 2 <M,(c)-1 


Tn (0 )(?n,l?i T n (1^2 ^)Pn ,£2 




M„(c)-1 

= E 

e=M n (b) 


Kn(t)Pn,e 


It is easy to see from the first identity in Lemma I A. 1 1 that 


A„ > (a + a )]EM„(b)T^( a -)Ejvf„(a+)T^( c ), Bn < ®'M n (b)T^( c ^/f>. 


“(«) 


Along with the fact that u n (a) x t n for all a € (0,1), one may apply (17.101) to the 
above inequalities to get E Mfc>i ( a )Tk n x t kn . Now, we choose L > 0 such that 


0 < E Mfeji ( a )Tfc n — A fcn x t kn , 


where the first inequality holds for n large enough. Since T n < t m one also has 


Var Mn(a) T„ < E Mn(a) T 2 < E m „ (o) (t^ ( c) ) 2 = VarM n (a)^ (c) + (E m „( 0 )(t^ ( c) ) 


(n) 


< Var 0^S(c) 


(Eor£ (c )) 2 < 2(E 0 r^ (c) ) 2 = 2u„(c) 2 
As a result of the one-sided Chebyshev inequality, this implies 


limsupP Mfcn(a ) (T kn < A fc „) < lim sup (l + ^ ^ 

n—> oo n—>-oo V Var Mk n (a)lk n 

In the assumption of (2) and (3), the proof for choosing (u rl (a))^L 1 as a cutoff 
time is given in the proof for (2)=^(1). In the assumption of (4), the equivalence 
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of cutoffs implies that v n (a ) = o(u n (a)) for all a € (0,1). As a consequence of the 
Chebyshev inequality, this yields that, for all a £ (0,1) and c > 0, 


limsupPo ( T^\ a ) ~ u n{a ) > cu n {a) J < limsup 

n .—Voo k ^ ' n .—^no 


i ( a ) 2 


l (a)' 


= 0. 


Along with the assumption of (4), one has t n ~ Eo t m\h) f° r a *= (0,1), as 
desired. □ 


Proof of Theorem 1 5.21 Set 

<5 = inf K n (i, i), K& = (. K n - 51)/{l - 5), H™ = > - J ). 

i,n 


It is easy to see that (X n , K n , ir n ) and (X n , H ^\, n n ) are respectively the d-lazy walk 
and the continuous time chain associated with (X n , Kn\ n n ). Let d ra ,TV, d^Tv and 

T„ iTV , T^tv and r| n \r| n,<5 ^ be respectively the total variation distances, the total 
variation mixing times and the first hitting times to state i of chains (X ni K n , 7r„) 
and (X n , Hnl,Tr n ). As a result of the following observation 

(7.12) H$ = = e^n-D/d-S), 

it is easy to see that the ratio of the spectral gaps of (X n , K ni i r n ) and (X ni H^\ , 7r„) 
is constant in n and, further, 

(7.13) = ( X “ s ) u n(a), Var 0 f^ a) ~ w n (a), 

where the latter also uses Remark 15.51 This is consistent with (13.31) . 

Set Tc 6 ' 1 = (X n , H^\, 7t„)^L 1 and let denote the family of chains in J 7 ^ 

started at the left boundary points. The remaining proof for the equivalence of (1), 
(2) and (3) is very similar to the proof of the discrete time case in Theorem 11.41 
if (ED and (13.21) hold under the replacement of J-jJ 7 ^ by T h , jFc 5 ' L \ These two 
equivalences are given by Theorem 3.4 in [Bj but the prerequisite of this theorem asks 
the existence of some e £ (0,1) such that T njTV (0, e) —> oo and T^%y(0,e) — > oo. 
(The authors of [6J point out the observation that such a requirement is missed in 
their article.) First, consider the requirement T^v(0, e) -A- oo. Recall the second 
inequality in Lemma 13.11 in the following 

dn, tv( 0, *) > Po (jiZZ) >*) ~ a - 

By Lemma [7721 (17.131) and the fact Var 0 r|”’^ < (E 0 r|"^\) 2 , the above inequality 
implies 

4 c ,w(0,a(l - 5)u n (a)) > min(e"' / “, ^ ^ —-^1 - a, Va £ (0,1). 

I Va + (l-a) 2 J 

This yields that 

t£$( 0, e) 

(7.14) liminf ———— >0 for e small enough. 
n-¥ oo u n (a) 

Since u n (a ) —> oo, we have T^v(0, e) —> oo for e small enough. 
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Next, we prove T njT v(0, e) —> oo. Note that one may use (17.1211 and the triangle 
inequality to derive 

(7.15) 4^tv(°! t) < P(JV t < to) + ¥(N t > m)d„ iTV (0, to), 

where (N t )t >o is a Poisson process with parameter 1/(1 — S). A simple application 
of the weak law of large numbers says that N t /t converges to 1/(1 — 5) in probability 
as t tends to infinity. By (17.141) and the assumption u n (a) —> oo, the replacement 
of t = (3u n (a) and m = \/3u n {a)~\ in (17.151) with small /3 implies that 

(7.16) liminf n,TV ^’ ^ >0 for e small enough. 

n->oo u n (a) 

This yields that T n> T v(0,e) —> oo for e small enough. 

To show (l)<t=>(4), let {N t ) t > 0 be the Poisson process as before. It is easy to see 
from (17.121) that if (li"')“ =0 is a realization of (X n ,K n , 7r„), then (X^)t >o is a 
realization of {X n , H^\, w n ). This implies 

P 0 (rl n ’ S) > s) = P 0 (X M < i, VO < r < s) 

(7.17) V 7 V 7 

= Po(^W < i, Vto < N s ) = P 0 (r( n) > N a J . 

Since u n (a) —> oo for some a £ (0,1), we obtain 

T l has a cutoff <(=> has a cutoff. 

By Theorem 15.11 the latter is equivalent to the existence of a sequence t n > 0 and 
a constant a £ (0,1) satisfying 

(7.18) t n =0 (e 0 rj^) , Vc £ (0,1) 
and 

( 7 - 19 ) ™ p ° - e )^) = !> Ve e (°> !) 

and, for any b £ (a, 1), there is a b £ (0,1) such that 

(7.20) limsupPo > (1 + e)f„) < a b , e £ (0,1). 

As a result of (17.131) . one can see that (17.181) is equivalent to t n = 0{u n {a )) and 
further, by (17.171) . (17.191) implies 

inninf P 0 (rW a) > “ P 0 (r<£ (o) > N { i_ e / 2)tfl ) 

= h „““ f P ° {^MnZ) >( 1 ~ e / 2 )tn) = !• 

and (17.201) implies 

limsupPo ( t mI lb) > - iimsupPo M^ (6) > N (i+e/ 2 )t„) 

n—>oo \ w L — 0 J n—¥oo v ' 

= limsupPo (tm’%) > (1 + e/2)t n ) < a b , 

for all e £ (0,1). This gives the desired properties in (4). Conversely, one may use 
a similar statement to prove (17.191) and (17.201) based on the observation of (4) and 
this part is omitted. 
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For a choice of the cutoff time, if (2) or (3) holds, the proof for the selected cutoff 
time is given by (17.1311 and Theorem 3.4 in [6]. If (4) holds, the proof is exactly the 
same as that of Theorem 15.11 and we skip it here. □ 

Proof of Corollary 1 5 . ,71 The ( u n {a),b n ) cutoff of F/f is immediately from (17.211 and 
Lemma 17.11 For the ( u n {a),b n ) cutoff of F L , the assumption inf„ b n > 0 and 
b n = o{u n {a)) implies that u n (a) —> oo for all a £ (0,1), which means that the 
cutoff time tends to infinity. The remaining proof also uses Theorem 3.4 in [6] and 
is similar to the proof of the discrete time case in Theorem II. 41 We refer the reader 
to Section [3] for details. 

□ 


8. Examples 


In this section, we consider some classical examples and use the developed theory 
to examine the existence of cutoff and, in particular, compute the cutoff time. First, 
we write J- = (X n , K n , 7r n )()8 =1 for a family of irreducible birth and death chains with 
X n = {0,1, ...,n} and write J- L ,J- R for families of chains in T started at the left 
and right boundary states. For the continuous time case, those families are written 
as T c , F/f , F/f instead. For n > 1 , let p n ,i,qn,i,r n ,i be the birth, death and holding 
rates in K n and rf, r}"-* be the first hitting times to state i of the nth chains in 
F,F C . For a £ (0,1), M n {a) denotes a state in X n satisfying 7r ra ([0, M n {a)]) > a 
and 7r n ([M„(a), n]) > 1 — a. 


(1) Biased random walk. For n £ N, let 


Pn,i = r ntTl = p, q n ,i+i = r n ,o = 9, VO < * < n, n > 1, 
with q = 1 — p £ (0,1/2). Note that the stationary distribution satisfies 

p/q- 1 


»(<) = 


This implies 

( 8 . 1 ) 


{p/q ) n+1 - i \q 

7Tn([0,i]) p/q-(p/q)' 


7 T n [i) 

By Lemma [A. 11 one has 


p/q- 1 


VO < i < n. 


VO < i < n. 


Eor^ = 


n— 1 

2=0 


(M) i 

pn n (i) 


Cn,i < Var iT^\ < 2C, 


where 


C n,i — 


p 2 7T„(i) 


E 

1=0 


n(M) 

7T n (0 


»(0- 


Applying (18.111 to the computation of Eor„ and Cn,i yields 

„2 / / „\ n \ y 


Eo W = 


P 


p-q q(p- qf 


l - 


9 — C n,i , no i V*, 

p vp - q) 


where the bound of Cn,i leads to Var 0 T)l ra ^ >c n. Observe that 7r„([0,n]) = 1 and 
7 T„{n) -A- 1 — q/p. As a consequence of Theorems 11.3111.41 and 16.11 with M n = n, 
the families J- Cl VF^ have a (^r^,\/n) cutoff in total variation and separation. To 
examine the existence of cutoff for J/f, we fix a € {q/p 2 — l,q/p). Based on the 
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observation that Tr n (n— 1) (p — q)/p 2 , one has M n (a ) = n— 1 for n large enough 
and this implies Var nJ^ia) = (E-nT^^) 2 • By Theorem 15. 11 T R has no cutoff in 
total variation. 


(2) Metropolis chains for exponential distributions Consider an increasing posi¬ 
tive function / on (0,oo). For n > 1, let 7r „(i) = TT n (0)f(i) and 

(8.2) p ni = r n o = 1/2, q ni+1 = 

2 /(* + 1 ) 

and 

(S.S) r ^ = l-2WTl)' V0<*<n-1, 

One can check that the nth chain is the Metropolis chain for n n with base chain the 
simple random walk on X n with holding probability 1/2 at boundaries. We refer 
the reader to [8] for details of Metropolis chains. 

It is worthwhile to note that K n is monotonic, i.e. + q n ,i+ 1 < 1 for all 
0 < * < n. By Corollary 4.2 in [12], separation of the nth chain in T ', J - L , J- R (and 
respectively in T c , , JF R ) is the same. As a result of Theorem o the existence 
of separation cutoff of J- is equivalent to that of T c and the cutoff time and window 
for T c given by Theorem II. II is applicable to T. For the total variation distance, if 
inf n ,ir n ,i > 0 is assumed, then Theorems II. 4115. ll and 15.21 and Remarks 11.61 and [531 
imply that the existence of cutoff of T (respectively T L 1 J- R ) is equivalent to that 
of T c (respectively Tf. T R ). Furthermore, the cutoff times and windows for J 7 , Jr 
given by Theorem 11.41 (respectively for , T R and for T R , T R given by Theorems 
15.11 and 15.21) are consistent in the way that the cutoff times are equal and the cutoff 
windows are of the same order. 

In this example, f(x) = exp{ax 13 } with a > 0 and (3 > 0. Note that inf„ j r n y > 
0 if (3 > 1 and inf ni j r n ,* = 0 if /3 S (0,1). In what follows, the cutoff phenomenon 
is discussed case by case according to [3. 

Case 1: /3 > 1. We first make some computations. Note that 

y-/(x) = al3x lj ~ l f(x) > a/3f(x) Vx > 1. 

This implies 


VO <i<n, 


r 77,.n — 1 


/(»-!) 

fin) 


^ /(j) < 1 + /(*) + ^ f{x)dx < 1 + f(i ) + /(*)• 

When i tends to infinity, one has 



This leads to 


/(*-!) 

/(*) 


= exp 


—a(3iP 1 



As a result, we obtain 


MM) = 1 + ^([°.'-i]) < 1+ A + j_ N | 

TT„(l) 7 T n (l) \ a(3 J 



/(»-!) 

/(*) 


1 


= 1 + 0 
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Replacing i with n gives n n [n) —> 1 and, by Lemma lA.il one has 

£„?<"> = 2E^M =2 „ +0(1) 

i=0 nn[l) 

and 


Var it\1\ 



2 

7 T n {i) ~ 1 


uniformly for 0 < i < n. 


The estimation of the variance implies Varor, 1 ^ >c n. By Theorem 11.31 11.41 and 
Theorem EH both F c and ■7 r ( f have a (2n, y/n) cutoff in total variation and sep¬ 
aration. For the family J/f, the observation, 7r n {n) —> 1, implies that the total 
variation mixing time of the nth chain is equal to 0 when n is large enough. 

Case 2: /3 = 1. Set 5 = (1 — e _a )/2. Note that ( K n — 51)/(I — 5) is the biased 
random walk on X n with p = 1/(1 + e~ a ). The result for biased random walks 
implies that F c and F^ have a ( 1 ^- a , y/n) cutoff in total variation and separation 
but FR has no total variation cutoff. 

In Cases 1 and 2, one has inf n> i r n ^ > 0. This implies that, in the total variation 
distance, the conclusion on the existence of cutoff, the cutoff time and the cutoff 
window also applies to F c . Fj:. F ( R . 

Case 3: 0 < /3 < 1. First, observe that 

^;(z 1-/3 /(z)) = oi/3f{x) + (1 - /3 )x~' 3 f{x). 

This implies 


i 1 0 f(j ) 

a/3 + (1 - /3 )j~P 


< f f(x)dx < 

Jj 


i 1 Pf(i) 

a/3 


VI < j < i. 


and then 


(8.4) 


1 

a /3 + (1 - /%' -/3 


( 1 _ j 1 fj fU) \ 

\ J 


< /(i)+•••+/(») < j_, ^-i 
i 1_ ^/(«) — a/3 


When i > 2 j and j oo, one has 



Consequently, we obtain, as j —> oo, 

(8.5) /(0) H-h f(i ) = + i^ 1 ) j uniformly for i > 2 j. 

Replacing i, j with n, [n/ 2J in (18.51) gives 

-Lj = „■--/(„) (A + »(!)) as » -4 oo. 

Next, we fix c > 0 and let c n be a sequence converging to c such that c ra ?r 1 ~' 3 £ 
A/,,. Set = n — c„n 1_/3 . Replacing i,/ with M n , [M. n /2\ in (18.51) yields 


M n 


lirn 7r„([0,M„])= lim 7r n (0) >/(£) = e 


£—0 


£( 0 , 1 ). 
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By Lemma [A. II one has, when 2 j n < i n < M n and j n —> oo, 


1 


^1=2 J2 


/(0) 


m 


e=o 


m 


2 n 2 P 

& 0 {2 - 0 ) 


o( 


n 2 -Pj^ 


+ n) 


where the second equality is given by separating Y^e < M into and Xu <e<M 

and then applying (18.411 and (|8.5I) respectively, and 


Varorjjg x ^ 

0<£<i<M n 


(/(0 ) + --- + / ffl ) 2 

mm 



2=0 


1 

/(*) 


E^ 2_2/3 /w> 

£=0 


where the computation uses (18.41) . Observe that 4 — 3/3 > 2-/3. Setting = \n 1 ^ 2 \ 

4 - 3/3 

and i n = [n 4 ~ 2 p J. Clearly, i n > 2 j n for n large enough and, in the computation of 
expectation, this leads to 


Eo r<£ 


2 n 2 ~P 
a/3(2 - 0) 


+ O (n 2 2 13 



Applying the following fact 

-^(a; 3_3/3 /(a;)) = [(3 - 3/3)/r 2_3/3 + a0x 2 ~ 2l3 ]f(x ) x x 2 ~ 2p f(x), Vx > 1, 
to the computation of the variance yields 


M n - 1 

Var 0 r^ x £ * 3 - 3 ^ x n 4 ” 3 ' 3 . 
2=0 


Similarly, one may use the observation that =—> e~ ca P to derive 

Qn,i x 1 uniformly for M n < i < n. 

By Lemma rA.il this implies 

E r {n) ~ V + + ~ 2—2/3 

i=M n +l 


and 


Var n T 


(n) 


n ‘M n 


Mr 


E 

,<i<£<n 


(/(0 + ‘ ' ~ + f( n )) 2 _ 4-4/3 

/«/(*) 


As a consequence of Theorem ll.3lll.4l and l6.ll .F c and Jqf have a ( ct |" 2 -'/j) 1 n2 ^ + 
n) cutoff in total variation and separation but, by Theorem 15.11 J/f has no total 
variation cutoff. Note that, when 0 £ (2/3,1), a better choice of the cutoff window 
is n 2 ~iP. To have this cutoff window, a more subtle estimation of the cutoff time 
is required. 

We summarize the above results in the following theorem. 


Theorem 8.1. Let f(x) = expjaaZ} with a > 0,0 > 0. Consider the family 
T = (X n , K n , Tr n )^L lt where X n = {0,1,..., n}, TT n (i) = 7r(0)/(z) and K n is a birth 
and death chain with transition rates 


Pn,i — Tn, 0 — 1/2, Qn,i+ 1 


f(i) _ 1 f{i) 

2f(i + 1) ’ 71,1+1 2 2/(* + 1) ’ 


V0 < i < n. 
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Then, T c and Tf have a ( t n ,b n ) cutoff in total variation and separation but Tff 
has no total variation cutoff, where 


t 


n 


2n for (3 > 1 

T%=* for P= 1 , b, 

irm^) / or o < /3 < l 


yfn for f3 > 1 

n 2-§/3 _|_ n j or o < p < 1 


(3) Metropolis chains for polynomial distributions In this example, we consider 
the family of Metropolis chains given by (18.21) and (18.31) with the replacement of 
f(x) by g(x) = exp{a(log(x + 1))^}, where a, (3 are positive. It has been shown in 
[7 that fF c has a cutoff in total variation and separation when f3 > 1 but has no 
cutoff when 0 < /3 < 1. The following theorem provides a cutoff time and a cutoff 
window when /3 > 1. 


Theorem 8.2. Let g(x) = exp{a(log(a; + 1))^} with a > 0 and f3 > 1. Consider 
the family T = {X n ,K n , 7t„)5£Lj, where X n = {0,1, ...,n} ; 7r n (z) = 7r(0 )g(i) and I\ n 
is a birth and death chain with transition rates 

Pn,i = r n ,0 = 1/2, Qn,i+1 = 77 7T~ 77, r n,i+ 1 = 77 77 7T~ TT, VO < i < U. 

2g(i + l) 2 2g[i + l) 

Then, fF c and fFff have a ( t n ,b n ) cutoff in total variation and separation but J-ff 
has no total variation cutoff, where 

^ n 2 n 2 

a(3Be(\ogn)P +e ~ 1 ’ ” (logn)^ -1 ) 

andB 0 = 1, B<, = 2 e {/3-l)l3---(l3 + e-2), N= > 0. 


Remark 8.1. Note that, in Theorem 18.21 f3 + N — 1 < |(/3 — !)</? + N. 


The proof of Theorem l8.2l is similar to the proof of the case (3 £ (0,1) in Theorem 
IQ and is placed in the appendix. 

(4) Metropolis chains for binomial distributions For n > 1, let 7 r n (i) = 2~ n (™j 
and 


Pn,i — Qn,n—i 


1 

2 ’ 


Qn,i +1 — Pn,n—i— 1 — 


i + 1 
2 (n — i) ’ 


VO < i < n/2, 


and 7> (; ,; = 1 — Pn,i — Qn,i for 0 < i < n. It is easy to check that K n is the Metropolis 
chain for 7r„ with base chain the simple random walk on X n with holding probability 
1/2 at the boundary states. The separation cutoff of this family is proved in [10] 
and we will discuss the cutoff time and the cutoff window in this example. First, 
one may use Lemma IA.1I and (15.21) to derive 


( 8 . 6 ) 


M n -1 

E 


.(M) 


nlogn 


Kn{i){l - tt ) 


0(n), 


E 


MM ) 2 

7T n (^)7 T n (i) 


i =0 n ' 0 <e<i<M n 

for any sequence M n £ X n satisfying \M n — f | = 0{y/n). Note that 


.« 1 - 


TTn-l(i) 


i-l (*) 


2 


7T n ([0,i]) = 7T n _i([0,i]) 


2 
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This implies 


(8.7) 


tt„ ([0, z]) = 27r„_i([0 ,•?]) _ 1 

7T n (i)(l-|) 7T n _l(*) 

Set M n = [n / 2J. By Lemma [Til (18.61) and (18.71) . we obtain 


: (n) _ '\ - 2^„([0, j]) 


Eots = E 

and 


2=0 


,(*) 


M n -1 

= E 


2=0 


Var 0 T$ x ]T x n* 

0<^M„ 

In a similar way, one has 


7T»+l([0,t]) 

^7Tn+l(*)(l ~ 7 I+t) 


7 Tn ([ 0,^]) 2 


+ [ = »log» +0(n) 


E « r Mi = nl ° gn + 0(n ), Var„r (n) - 2 


m„ ~ n ■ 
1, 


As a consequence of Theorems 11.3111.41 and liTT! fF c has a (^nlogn,n) separation 
cutoff and T„, have a (in log n, n) total variation cutoff. 


Appendix A. Auxiliary results and proofs 


Lemma A.l. Consider an irreducible birth and death chain on {0,1, ...,n} with 
transition rates pi,qi,ri and stationary distribution n. LetTi,Ti be the hitting times 
in (EH). Then, one has 


and 


and 


^i'Ti+l — (-1 — 


^([M) 

7T (l)pi 


Var^Tj+i) 


-To E ^(OPtTi+l + E t Ti - 1], 

Pin*) 


Var^Tj+i) = 


-FT E 7r MP E f T i+l + E <Ti]- 


Proof. See [2] for a proof of the discrete time case. The continuous time case is a 
simple corollary of the discrete time case. □ 

Proof of Remark \l.l\ Let t n , X n ,i, A n , a n , p n be the notations in Theorem 11.11 It 
has been proved in pUJj that 

(A.l) T has a separation cutoff <t=> t n A„ —> oo 


and 

L tn - (1/e - l) 1/2 p n \ < T„, sep (0, e) < \t n + (1/e - 1 ) 1/2 Pn \, Ve £ (0,1). 
These inequalities imply 

|T„, sep (0, e) - t n | < (1/e - 1 ) 1/2 p n + 1, Ve £ (0,1). 

Note that A„^ < 2 for 1 < i < n. Clearly, this yields t n > n/2. As a consequence, 
if p n = o(t n ) or equivalently max{p n , 1} = o(t n ), then T has a (t n , max{/)„, 1}) 
separation cutoff. 
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To see the inverse direction, note that 

max{^,l/A^} < y~. 

An 

This implies 

\/tn An ^ r / a T ^ t n An, 

nrax{ p n , 1 / A„| 

and, as a result, we have 

(A.2) t n \ n -too 4=> max{/9 n , 1/A n } = o(t n ). 

By (IA.1I) and (IA.2I) . .F L has a separation cutoff if and only if max{p„, 1/A n } = o(t n ). 
Further, if T has a separation cutoff, then p n = o(t n ). □ 


Proof of Lemma \2.2l Let n be the stationary distribution of K. Since tt is a re¬ 
versible measure for K , the spectra of K , Li are real. The interlacing property of 
Xj. xf':^ is given by Theorem 4.3.8 of fH]. Clearly, this gives the first inequality 
1/Ai < 1/A^. Note that 


\(i) 

A-[ = mm 


(( I-K)f,f) r 


f(i) = 0 , 


k(P) 

where (g,h) v = Sj=o5(i)^(i) 7r (i)- By Proposition A.2 and Theorem 3.8 of [7], 
one has 


— < A«> < 


4C( 


1 


C(i) ’ 4 C(i) 


- < Ai < 


min{7r([0, f]), 7r([z, n])}C(i) ’ 


where 


C(i ) = max < max 


r([0,j]) 


max 


E 


r ([?>]) 


o <j<i 7r (£)K(£, £ + 1) ’ i<j<n n(£)K(£, t—l)\ 


This gives the second inequality 1/A^ < (4/ min{7r([0,i]),7r([i,n])})/Ai. □ 


Proof of Lemma \ 7. 1\ Let pk,qk,rk be the transition rates of K. We first consider 
the continuous time case. By Lemma lA.il we have, for 0 < i < j < n, 

j-i i k k i - 1 i k 

Var Pj > —ffnf 7 E <*) E E mr m+ i = ^ — 7^ E ^I 0 ’ m])E m T m+1 

k=i ' ' £—0 m—£ k=i ' ' m—0 


^ tt( [0, i]) ^tt([0 , k })* 


— !]) PfcTr(fc) f- 


- !]) 


k=i 
j~ 1 & 


m—% 


r(M) 


rrEEE EfcTfc+ilEn-iTni+l A ■ 11 ^ )' . 


k—i m=i 


2tt([ 0, j - 1]) 


This proves the lower bound. 

For the upper bound, let ai < • • ■ < a* and b± <■■■< bj be the eigenvalues of 
the submatrices of I — K indexed respectively by 0,..., A — 1 and 0,..., j — 1. By the 
strong Markov property, the first hitting time to state i started at 0 and the first 
hitting time to state j started at i are independent. By Lemma 12.11 this implies 


1 1 ^, x -1' ^ 

E Pj = E r ~ E — > Var 'T? = Var o Tj - Varori = E JS 

k= 1 fc=l Qk k=1 


E 


fc=i 


1 
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Inductively applying Theorem 4.3.8 of [13] yields the fact that 

a* > bk, VI < k < i. 


As a result, we have 



For the discrete time case, let <1 = min* K(i, i) and set = (K — 61)/(I — 6). 
Let be the first hitting times to state i of the discrete time and continuous 

time chains associated with K^ s \ Let ci < < c, and d\ < ■ ■ ■ < dj be the 

eigenvalues of the submatrices of / — indexed respectively by 0,..., A — 1 and 
0, ...,j — 1. It is clear that (1 — <5)ci,..., (1 — 6)ci and (1 — 6)di ,..., (1 — S)dj are 
the eigenvalues of the submatrices of I — K indexed respectively by 0,..., A — 1 and 
01. By Lemma \‘2 .11 we have 

^ 1 ^ i E^ a) 

iTj _ ^ - S) d k “ (1-5) 

and 

1 — (1 — 8)dk 1 — (1 — S)ck 

ariT? ~ S a-w 

The bounds for Var^Tj are immediately obtained by the result in the continuous 
time case and the following equalities. 

Var 5Var i rj' 5 - ) Var 

13 (1 — 6) 2 1-5 (1-5) 2 1-6 ' 

□ 


Proof of Lemma [7~i] Let be the eigenvalues of the submatrix of / — K 

indexed by {0, ...,i — 1}. By Lemma l2Jl one has 

* i i i 

E 0 Ti = ^—, Var 0 Ti = ^ T2 • 
fc=l Ak k =i Afc 

These identities imply Varo?) < Eot^/A, where A = min{Afe|l < k < ?}. As a result 
of the one-sided Chebyshev inequality, we have, for a £ (0,1), 

°^ ' > ° 1 + (1 - a) 2 (E 0 T i ) 2 /Var 0 Tj “ 1 + (1 - a) 2 AE 0 T) 

Let b be a positive constant. If AEot) > 6, then 

P,(7i>»Eoy.)>l- 1 + (1 1 _ tt)3t . 

Brown and Shao proved in [3] that, under Pp, r,; has the distribution as the sum of 
exponential random variables with parameters Ai,..., A*. In the case of AEp?) < 6, 
this leads to 


Pp(ri > aEpTi) > exp{—aAEpTi} > e ab . 
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Summarizing both cases yields 

Po(a > aE 0 fj) > min { e ~ ab , 1 - 


1 + (1 — a) 2 b J ' 


Taking 6 = 1/ i/a gives the desired inequality. 


□ 


Proof of Lemma m For simplicity, we set r = min{rj,Tfc}. The first equality is 
clear from the definition. To see the second equality, note that it follows immedi¬ 
ately from the Markov property that 


EjT — («i + • • • + Kk-i-l) 

where 


l+7i-l-f 7j-i-i 

1 + 7i H-h lk-i-i 


Qi+lQi+2 ■ ■ ■ Qi+e 

7 1 = -, Kt = 

Pi+lPi+2 ' ' ' Pi+i 


Qi+l qi+ 2 'n 


— («1 + • • • + Kj-i-l), 


If- 


qi+eif-i 


The proof of the above identity is somewhat complicated and we refer the reader 
to Equation (3.66) in [T5] for a proof. Observe that 


EjT( 1 + 7l + • • • + 7fc-i-l) —( K j-i + ' ‘ ‘ + Kk-i-l ) 


(A.3) 


and 


+ Y (7<1«<2 - «<l7< 2 ) 


7- K+7A = 


1 




l 


7A7A 


.qi+ti+iiti qi+fiih-i, 

In some computations, one can see that 7 f = (n(i)pi) / (Tr(i + £)pi+f). This implies 


7r([* + l,* + ^]) ^ 

-, Y 


1 7r([* + l\ + 1, i + £ 2 ]) 


n(i + i)p i+ £ 


t=t 1+1 


and 


q i+i 7 £_i t r(i)pi 

n([i + e 1 + l,i + 4 ])tt (i)pj 

7r(z + £i)p i+ei Tr(i + h)Pi+e 2 ' 

Putting the above identities back to (IA.3I) gives 


7+K+. - K fl ll 2 = 


k -1 


fc-1 


EjT n(i) P i Y ■ 


r {i)pi 


_ ^([i + 1,1]) y- 

^ n(£)p e ^ 


ir([Ci + M 2 ])tt (i)pi 


t=3 




= 7T(i)pi ^ 


= 7r(i)pi ^ 


7r([£l + 1, f? 2 ]) 

j<t 2 <k-l 

7r([4,^2]) 




^(h)qf 1 '^(h)pe 2 1 


where the last equality uses the fact 7 r(i — l)pi-i = Tr(i)qi- 


□ 





















COMPUTING CUTOFF TIMES OF BIRTH AND DEATH CHAINS 


43 


Proof of Theorem 1 8. 21 First, observe that 


= a/3 + 


(x + l)g(s) 
dx ^(log(x + 1 )) /3_1 / 

Set *o = e 9 ' 1 . For i > j > i 0 — 1, one has 


1 - (/3- l)/log(x + 1) 
(log(x + I ))/ 3 " 1 


9{x). 


A 


_ ^ (log(i + l))' 9 - 

a/3 + (log(j + l)) 1- ^ “ (i + 1 )g(i) 


< 


g(*)dx < — p , 


where 


, . = 1 _ (j + i)(i°g(i + 1)) 1 Pgjj) n 

1,3 (i + l)(log(* + l)) 1_/3 g(j) 

This implies, for i > j > io — 1, 

(log(* + [3(0) + • • • + 9 ( 1 )} j<^+ io(1 ° 5 ^ )) 

A,- 


/3-1 


(A.4) 




> 


— a/3 + (log(j+l)) 1 -f' ■ 


Note that, for log(i + 1) > 21og(j + 1) and i —> 00 , 


(log(i + l))^-V ' 


This implies that, when log(* + 1) > 21og(j + 1) and j —> 00 , 

Ai,j = l + o ((log(j + l)) 1- *) • 

By (IA.4I) . one has, as j —> 00 , 

(log(* + 1))^ _1 [3(0) + • • • + g(i)] _ 1 


(A.5) 




a/3 


O ((log(j + I)) 1 ”' 3 ) 


uniformly for log(i + 1 ) > 2 log(j + 1 ). 

Let c n be a sequence such that c„n(log(?r + l )) 1- ' 9 £ X n and set M n = n[ 1 — 
c„(log(n+ 1)) 1_/3 ]. Suppose that c n converges to some positive constant c. Replac¬ 
ing i,j with n, [ \Jn — lj and then with M n , [y/M n — lj in (IA.5I) gives 


{n + 1 )g{n) 


lim 7r n ([0,M n ]) = e a/9c . 


7 r„( 0 ) a/3(log(n + l ))^ 3 11 

Next, we compute the expectation and variance of the first hitting time with initial 
state 0. By Lemma TA. 11 one has 


M n -1 


Eo = 2 Y, 


3(0) H-b3W ^ ~(n) 

-, Var 0 tW 


i =0 


3W 


E 


(3(0) 


3W) : 


3(*)3W 


To sum up the right side of the above identities, we need the following computations. 
An application of the integration by parts gives that, for k £ {0,1,2,...}, 


x + 1 


(A. 6 ) 


(log(x + 1 ))^ 


~ dx =E 


(x + 1) 5 


£=0 


2Be(log(x + l))P +e ~ 
f x +1 


B k+ i(log(x + l))/ 3+fe 


dx, 
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where Bq = 1 and Be = 2 £ (/3 — 1 )/3 • • • (/3 + £ — 2). This implies, for £ n —> oo and 
log(M n )/log(£n) oo, 

rM n x + 1 ^ 

Jin (log(a; + l))0~ ldx E 


e=o 


(M n + l) 2 
2B / (log(Af n + !))*»+*- 


O 


M„ 2 


(logM n )^+V ' 


Using the following computations, 

( M n + l) 2 = n 2 ( 1 + O 

and 


1 


1 


1 


(log(M n + l))P (log n)P 
one may rewrite (IA.7I) as 

i k 


1 + 0 


(log n)/ 3-1 

1 

(logn)/ 3 


Vp > 0, 


(A.8) 


x +1 


h n (log(x + 1)) /3 


~ dx = J2 


e=o 


2Be(\og n) /3 + £ 


-l 


O 


(log n) 2 P~ 2 J 


Set N = [4^] > 0 and let i n ,j n G X n be states satisfying log(* n + 1) > 
21og(j„ + 1), j n —> oo and \ogM n /logi n —> oo. By (1A.4I) and (1A.6I) with k = 0, 
one has 


E 

i<i n 


m 


■9{t) 


x + 1 


9W 


dx 


h (log(a; + l))/ 3 " 1 (log*„)^ 


= o(logrc), 


and, by (1A.5D and (1A.8I) with k = N, we get 


N 


y- g(0) + • • • + ff(l) __ 
^ g(£) 


2a/3Be(\ogn) l3+e 


-l 


O 


i n <e<M n ' l—Q 

Putting both summations together and applying the setting, j n = 


and i n = 


eV 2 (iog")j - l, yields 


(log TL log Jn)/ 3-1 , 

'logn jj _ ^ 


N 2 / 2, \ 

S “^^(logn)/ 3 ^ -1 + ° \ (log n)iO~i) J ‘ 

For the variance, note that 

d_ f (x + 1 ) 3 \ 

dx \ (log(x + l)) 3 / 3-3 ^ J 

{x + l) 2 g(x) f 3 _ 3(/3-l) \ 

(log(a; + I)) 2 / 3 ' 2 ^ P (log^+l))/ 3 - 1 (log(x + l)W 

and 

d( Qr + 1) 4 \ (x + 1) 3 / 3(/3 — 1) \ 

da; \ (log(a; + l)) 3 ^ -3 / (log(x + l)) 3 / 3-3 \ log(x + 1)/ 

By (IA.4II . this implies 

(g(0) + ... + g(l)) 2 ^ r (x + 1 fg{x) (i + l) 3 g(i) 

9 (^) iio ( lo gO + i)) 2 ^" 2 (log(*+ 1)) 3 / 3 - 3 
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and then 


VaroTj”j x J2 


(i + lf 


f-Mr, 


(x + l) 3 


0 <i<M, 

(M n + l) 4 


(log(i + I )) 3 / 3 - 3 


(log (a; + l)) 3/3_3 


dx 


(log(M„ + l)) 3 ^ -3 (logn) 3/3_3 ' 

Now, we compute the expectation and variance of the first hitting with initial 
state n. Note that 


g(M n ) 


iim 

n-> 00 g(n) 


= e 


This implies u\i{q n i \M n < i < n,n > 1} > 0 and, by Lemma [A. II 


Eji 


~(™) 

'M n 


E 

M n <i<n 


g(i) 


g(n) 


g(i) 


(n - M n f 


(log n) 2 P- 2 


and 


Var„r 


(™) 

Mn 


Y, (g(Q EuE g(n))2 x(n-M„) 4 


M n <i<I<n 


g(i)g(t) 


(log n) 4 ^ 


-4 ‘ 


The desired cutoff time and cutoff window are given by Theorems 11.3111.4115.11 and 

ECU □ 
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